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BOUNDED LITTLEWOOD IDENTITIES 


ERIC M. RAINS AND S. OLE WARNAAR 

Abstract. We describe a method, based on the theory of Macdonald 
Koornwinder polynomials, for proving bounded Littlewood identities. Our 
approach provides an alternative to Macdonald’s partial fraction technique 
and results in the first examples of bounded Littlewood identities for Mac¬ 
donald polynomials. These identities, which take the form of decomposition 
formulas for Macdonald polynomials of type ( R , S) in terms Macdonald 
polynomials of type A, are q , f-analogues of known branching formulas for 
characters of the symplectic, orthogonal and special orthogonal groups, im¬ 
portant in the theory of plane partitions. 

As applications of our results we obtain combinatorial formulas for charac¬ 
ters of affine Lie algebras, Rogers-Ramanujan identities for such algebras 
complementing recent results of Griffin et al ., and transformation formulas 
for Kaneko-Macdonald-type hypergeometric series. 

Keywords: Macdonald-Koornwinder polynomials, Hall Littlewood poly¬ 
nomials, virtual Koornwinder integrals, characters formulas, Rogers-Ramanujan 
identities. 
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1. Introduction 


In his 1950 text on group characters [59] D. E. Littlewood presented three 
identities for Schur functions which can be viewed as reciprocals of the Weyl 
denominator formulas for the classical groups B n , C„ and I)„. The B n case— 
which earlier appeared in an exercise by Schur [86]—is given by [59] Eq. (11.9; 6)] 


( 1 . 1 ) 
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where s\(x) = s\(xi,... ,x n ) is a Schur function indexed by the partition A. 
Almost 30 years later, Macdonald [63J proved the following bounded analogue 

of (HH) 
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for m a nonnegative integer, and observed that it implied MacMahon’s fa¬ 
mous conjecture for the generating function of symmetric plane partitions. 
By reading off the ‘sequence of diagonal slices’—an idea of Okounkov and 
Reshetikhin m more recent than [63]—it immediately follows that the gener¬ 
ating function for symmetric plane partitions n contained in a box B (n,n,m) 
of size n x n x m is given by 


55 . 
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Ai^m 


Hence MacMahon’s formula [68] (see [46] for a recent survey) 
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should follow from the evaluation of the determinant in (II. 2\i when Xi = q 2l ~ l 
for 1 ^ i ^ n. Since this determinant is essentially a character of the irre¬ 
ducible SO(2n+l, C)-module of highest weight mA„, the required determinant 
evaluation corresponds to the (/-dimension of this module, and follows from the 
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Weyl character formula. To prove (j 1.2ft — a SO(2n + 1, C) to GL(n, C) branch¬ 
ing formula—Macdonald developed a partial fraction method, resulting in a 
more general t-analogue for Hall-Littlewood polynomials. 

Since the work of Littlewood and Macdonald many additional Littlewood 
identities have been discovered and applied to problems in combinatorics, rep¬ 
resentation theory and g-series. Examples include the enumeration of plane 
partitions and related combinatorial objects such as tableaux, tilings and 
alternating-sign matrices [71IS1 fill U^lU^l 1201I2§1I3CT1I44117511751155] , the compu¬ 
tation of characters and branching rules for classical groups and affine Lie 
algebras [5H351I41II42II451I72] and the proof of Rogers-Ramanujan and elliptic hy¬ 
pergeometric series identities [5T1I511I^7E71[7^1IS51I95] . Surprisingly, despite the 
interest in Littlewood identities, q, f-analogues of (11.2ft and other bounded Lit¬ 
tlewood identities for Schur and Hall-Littlewood polynomials have remained 
elusive. In this paper we present an approach to Littlewood identities based on 
the theory of Macdonald-Koornwinder polynomials. As a result we obtain the 
missing q, f-analogues, including the following generalisation of Macdonald’s 

(O0. 

Theorem 1.1. For x — (x\,..., x n ) and m a nonnegative integer, 

l _ qm-a'(s)j.l'(s) 1 _ qa(s)j.l(s)+1 

( * 1 * ‘ 3 ) P\( X ',q,t) J_| X - 0 m-a'( S )-14'( { )+l 11 1 _ a a(s)+l t l(s) 

A seA y seA H ■ 

Ai^ra l'(s) even l(s) even 

= (xi ■ ■ ■ x n )T P ( ( |^ Bn) (x; q, t, t). 

On the left, a(s), l(s), a'(s), l’(s) are the arm-length, leg-length, arm-colength 
and leg-colength of the square s € A and P\(x]q,t ) is a Macdonald polyno¬ 
mial of type A. The (Laurent) polynomial P^^ n \x] q, t, t) on the right is a 

Macdonald polynomial attached to the pair of root systems (B n , B n ) indexed 
by the rectangular partition or ‘half-partition’ (m/2,..., m/2). 

Our method also leads to alternative proofs as well as further examples of 
Littlewood identities for the characters of irreducible highest weight modules of 
affine Lie algebras, first discovered in [5] . In particular our methods shows that 
such characters arise by taking suitable limits of Hall-Littlewood polynomials 
of type R. For example, for the twisted affine Lie algebra PS^n we ma Y claim 
the following result in terms of modified Hall-Littlewood polynomials P\(x\ t) 

/D \ 

and the large-r limit of the Hall-Littlewood polynomial P^n(x‘,t,t 2 )- 


1 (B C 

i An alternative generalisation in terms of Pkw r ‘ 

V 2 ) 


is given in Theorem 14.61 
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Theorem 1.2. Let ao,... ,a n and A 0 ,..., A n be the simple roots and funda¬ 
mental weights of , and S = 2 a 0 + • • • + 2a n _! + a n the null root. Set 

t = e~ 5 and x { = e~ ai “n-i-“n/ 2 5 

and let ch V (A) denote the character of the integrable highest-weight module 
V (A) of highest weight A. Then, for m a positive integer, 

(1.4) e _mA ° ch V (mA 0 ) = lim t^ mnN2 ( t 1/2 X ; t, 0) 

= ^ t |A|/2 Pj;(xf,...,^;t), 

A 

Ai^m 

where X = X N (x\t) is the alphabet 

(1-5) X = (xf, txf,..., t N ~ l xf, ., x±, tx±..., t N ^x^) 

and (..., axf , axi, axf 1 ,...). 

As shown by Griffin et al. m, character formulas such as ('ll.jj) imply 
Rogers-Ramanujan identities through specialisation. Following their approach, 
we obtain several new examples of Rogers-Ramanujan identities labelled by 
affine Lie algebras. For example, from (1 1.4 p we obtain the following new iden¬ 
tity, where P\(x]t) is a Hall-Littlewood polynomial, 9(x;q) a modified theta 
function and (q; q)^ a g-shifted factorial. 

(o) 

Theorem 1.3 Rogers-Ramanujan identity). For m ,n positive integers 
let k = m + 2n + 1. Then 


£ 9 w/ 2 A(i, 9 , 9 2 ,... ;9 2 “) 

A 

Ai^m 


( 9 k ; r)h Hr' 12 , <A 2 ) 


Y[o(rF 2 ) n <n 

i= 1 l^i<j^n 


As a final application we show that the bounded Littlewood identities for 
Macdonald polynomials imply transformation formulas for multiple basic hy¬ 
pergeometric series of Kaneko—Macdonald type. 


The remainder of this paper is organised as follows. In the next section 
we review some standard material from Macdonald-Koornwinder theory. This 
includes a discussion of ordinary (or type A) Macdonald polynomials, Koorn- 
winder polynomials and their lifted and virtual analogues, generalised Macdon¬ 
ald polynomials of type (R, S), Hall-Littlewood polynomials and Rogers-Szego 
polynomials. 
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In Section [3] we consider two functionals on the ring of symmetric function 
known as virtual Koornwinder integrals. We review a number of earlier results 
for virtual Koornwinder integrals and prove several new integral evaluations. 

In Section H] we present our approach to bounded Littlewood identities. The 
key idea is to show that each bounded Littlewood identity is equivalent to the 
closed-form evaluation of a virtual Koornwinder integral. We apply our method 
to prove several new bounded Littlewood identities, including Theorem 11.11 and 
a q, f-analogue of the well-known Desarmenien-Proctor-Stembridge determi¬ 
nant, see Theorem 14.11 below. 

Section 0 contains applications of the results of Section QJ First we show how 
bounded Littlewood identities give rise to combinatorial formulas for charac¬ 
ters of affine Lie algebras, such as Theorem 11.21 This provides an alternative 
to the recent approach of Bartlett and the second author based on the C n 
Bailey lemma [5]. As a second application we follow recent ideas of Grif¬ 
fin et al. [31] and apply the combinatorial character identities to prove new 
Rogers-Ramanujan identities for the affine Lie algebras B^ 1 ^, A^_ x , Aj,^ and 

D,^. The Rogers-Ramanujan identity for Bn\ given in Theorem 15.121 and 
Remark 15.131 generalise Bressoud’s even modulus analogues of the celebrated 
Andrews-Gordon identities. Finally, by appropriately specialising bounded 
Littlewood identities for Macdonald polynomials, we prove new transformation 
formulas for multivariable basic hypergeometric series of Kaneko-Macdonald- 
type [391 167], 

We conclude with an appendix containing some technical lemmas pertaining 
to the Weyl-Kac formula. 

Acknowledgements. We thank Michael Schlosser, Hjalmar Rosengren and 
Jasper Stokman for helpful discussions on hypergeometric function, Macdon¬ 
ald identities and Macdonald-Koornwinder polynomials. We thank Richard 
Stanley for pointing out the paper [SB] by Schur. 


2. Macdonald-Koornwinder theory 

2.1. Partitions. 

A partition A = (Ai, A 2 ,...) is a weakly decreasing sequence of nonnegative 
integers such that only hnitely-many A* are positive. The positive A, are called 
the parts of A, and the number of parts, denoted l( A), is called the length 
of A. As is customary, we often ignore the tail of zeros of a partition. If 
| A| := JA A i = n we say that A is a partition of n. The unique partition of 0 
is denoted by 0. As usual we identify a partition with its Young diagram— 
a collection of left-aligned rows of squares such that the Ah row contains Aj 
squares. For example, the partition (5, 3, 3,1) corresponds to 
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The conjugate partition X' is obtained from A by reflection in the main diag¬ 
onal, so that the parts of X' are given by the columns of A. Given a partition 
A, the multiplicity m;(A) = A' - A' +1 counts the number of parts of size i. 
If A is a rectangular partition consisting of m rows and n columns we write 
A = m n . If A is a partition of length at most n we also write A + m n for 
(m + Ai,..., m + A n ). Finally, the number of even/odd parts of A will be 
denoted by even(A)/odd(A). 

For two partitions A ,/i we write /i C A if fi is contained in A, i.e., if /ij ^ A i 
for all i ^ 1. In this case the set-theoretic difference between A and /i is called 
a skew shape. To avoid a notational clash with partition complementation 
to be defined shortly, we write this difference as X//j, instead of the the more 
common A — /i. For example, the skew shape (5, 3, 3,1)/(3, 3,1) is given by 



A skew shape A//r containing at most one square in each column, as in the 
above example, is referred to as a horizontal strip. Analogously, a vertical 
strip is a skew diagram with at most one square in each row. If A C m n we 
write the complement of A with respect to m n as m n — A, that is, m n — A = 
(m — X n ,... ,m — X 2 , m — Ai). For example, the complement of (3,2) with 
respect to (4 3 ) is (4,2,1). 

The dominance order on the set of partitions is defined as follows: A ^ /i if 
Ai + • • • + Afc ^ Hi + ■ ■ ■ + fik for all k ^ 1. Note that unlike [64] we do not 
assume |A| = \/i\. If A ^ p, and A//iwe write A > /i. 

The arm-length, arm-colength, leg-length and lcg-colcngth of the square 
s = (i,j) G A are given by 


a(s ) = a x (s ) = Xi~ j, a'(s ) = a' x (s) = j - 1, 

l(s) = l x (s ) = X'j - i , l\s) = l' x (s) =i - 1, 

and the hook-length of s is h(s ) = a(s ) + l(s ) + 1. As usual, the statistic n(A) 


is given by 



Finally, we say that A = (Ai,..., A n ) is a half-partition if Ai ^ A 2 ^ ^ 

X n > 0 and all A* are half-integers. We sometimes write this as A = /i + (l/2) n 
with ^ a partition of length at most n. Conversely, if A = fi + { 1/2) n we 
also write /i — X — (l/2) n . The length of a half-partition A = (Ai, ...,A n ) 
is by definition n, and rrii( A) for i a positive half-integer is the multiplicity 
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of parts of size i. We use half-partitions to generalise our earlier notion of 
complementation so that m n — A makes sense for m an integer or half-integer 
and A C m n a partition (of length at most n) or half-partition (of length n). For 
example, 4 3 - (5/2, 3/2, 3/2) = (5/2, 5/2, 3/2) and (7/2) 3 - (5/2, 3/2, 3/2) = 
(2,2,1). We also extend the dominance order to the set of half-partitions 
in the obvious way. However, partitions and half-partitions are by definition 
incomparable. 


2.2. Generalised g-shifted factorials. 

Let 

(z',q)oo := ]^[(1 - zq l ) and (z;q) n 

i^O 


(z; q) oo 

(■ zq n ; q )oo 


be the standard g-shifted factorials [27]. In this paper we will mostly view 
g-series as formal power series, but occasionally we require g to be a complex 
variable such that |g| < 1. The modified theta function is defined as 


(2.1) 0(z; q) := (z; q) O0 {q/z\ q )= 


(9; ?)c 


^z fc gvfor z ^ 0, 


kez 


where the equality between the product and the sum is known as the Jacobi 
triple product identity. We also need more general g-shifted factorials indexed 
by partitions: 


(2.2a) 

(2.2b) 


(z',q,t )a := 
C\{z]q,t) 


]\(l-zq a 'Wt- l 'W)=l[(zi l ^q) } 

se A 

Y[ (1 - zq a{s) t l(s) ) 


i= 1 


sG A 




i— 1 


l^iKj^n 


(zt 3 1 ; q)x i -\ j 
(zt j “h g)A i -A, 


The choice of n on the right is irrelevant as long as n ^ Z(A). We note that 
(a; g, 7) a is sometimes denoted as C A (a; g, t), see e.g., [ST], and that C x (t: q, t ) = 
C\(q,t ) and C x (q-,q,t) = c x (q,t), with c\ and c A the hook-length polynomials 
of Macdonald m page 352], In particular, C x (g; g, g) = c A (g, g) = c A (g, g) = 
/J A (g) with 77a( g) = n, G A (1 — g^ s ') the classical hook-length polynomial. For 
s G A let 

X _ q a AbO^UbO+i 

^a(s, 9) 0 •— 1 _ qa x (s)+lfl x (s) ‘ 

Then 


(2.3) 


6a( 9 ,t) 


Ca(9,7) 

c' a (9,7) 


JJ& A (s;g,t). 

se A 
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For each of the g-shifted factorials as well as the theta function we use con¬ 
densed notation, such as 

(zi, ...,z k ;q, t) x = ( 21 ; q, t) x ■ ■ • {z k \q, t) x . 

It is an elementary exercise to verify the following identities, which will be 
used throughout the paper: 

(2.4a) (a-,q,t) x . = (-«)' <?)a 

(2.4b) Cy(a-,q,t) = C^(a;t,q) 

and 

(2.5a) (a; q, t) 2 a = (a, ag; g 2 , t) x 

(2.5b) Q, t) = Cl (a, ag; g 2 , t) 

for 2A := (2Ai, 2 A 2 ,...), and 

(2.6a) (a; g, t) m n_ x = (_)|A| n(V) t -n(A) (a;g,*)m~ 

K ’ ; )m a ill (gi-™^-i/a;g,f) A 

12 6bf C" la- a - 1—o 1_m /aV A| a n(A ' ) f- n(A) g ’ ( fl i *) 

(2.6b) C m n_ x (a, q,t) — { q /a) q t (ai n-i ; g i-™ /a; ^ ■ 

2.3. Rogers—Szego polynomials. 

For integers k, n such that 0 ^ fc ^ n let 


{q',q)r 


( q-,q)k(q- 1 q)n-k 


be a g-binomial coefficient. Then the Rogers-Szego polynomials H m {z\ q) are 
defined as [9Tj . 

m r 

(2.7) H m (z-q):=J2^ T 

fc=0 L J 9 

for m a nonnegative integer. They satisfy the three-term recurrence 

H m+1 (z- q) = (1 + z)H m (z ; g) - (1 - g m hR m _i(z; g) 

with initial conditions H_ 1 = 0, R 0 = h and are orthogonal on the unit circle 
with respect to the weight function 

w(z;q) = \(zq 1/2 - 1 q) OQ \ 2 (0 < q < 1). 

The Rogers-Szego polynomials are closely related to symmetric functions 
and may be expressed in terms of Schur functions as 

~n(A) 


Hm{z', q) — (q) m '/ > ^ 


q 


Ah m 


Hx(q ) 


s a(1, z), 


with H x (q) the hook-length polynomial. 
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We require two generalisations of the Rogers-Szego polynomials to polyno¬ 
mials indexed by partitions. First, 

m —1 m— 1 

(2.8) h[ m \a, b: q) := J] (-a ) m ' w H^b/a- q) JJ H mW (ab-, q) 

i=l i=1 

i odd i even 

m— 1 m— 1 

= (-a)”"! 1 ' J] H mm (b/a-,q) f[ H mW (ab;q), 

i=l i=1 

i odd i even 

where m is a nonnegative integer. Compared to earlier definitions in [5,96] 
the parameters a and b have been replaced by their negatives. Since H m is a 
reciprocal polynomial it follows that (a, 6; q ) is symmetric in a and b: 

h { ™\a,b-, q) = h [ ™\b,a] q). 

Since m*(A) = 0 for i > Ai, the upper bound on the products over i in (j2.8j) 
may be dropped if m ^ Ai + 1. For such m we simply write h\(a , 6; q). That 
is, 

(2.9) h\(a, b; q) — JJ (-a) miW H m . {x) (b/a; q) JJ H m . {x) (ab] q). 

i^l i^l 

i odd i even 


We further define 

m—1 

(2.10) := hj n) (a,-l;f) = H m . {x) (-a]t). 

1=1 

Since [96j 

(2.11a) if m (0;t) = l 

(2.11b) = h i;i2)m/2 

I 0 m odd 

(2.11c) H m (-t;t) = (i;« 2 )r m / 2 i 


(2.lid) ff m (i 1/2 ;«) = (-* 1/2 ;« 1/2 ) 


there are a number of choices for a and b for which 02.8p and (12. lOjl completely 
factor. This will be important later when considering character formulas for 
affine Lie algebras. 


2.4. Plethystic notation. 

Let & n be the symmetric group on n letters, A n = F[aq,... ,x n ] 6n the ring 
of symmetric functions in the alphabet Xi,... ,x n with coefficients in F, and 
A the corresponding ring of symmetric functions in countably many variables, 
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see [53]. We will mostly consider F = Q(q,t) or F = Q(q,t,t 0 ,ti,t 2 ,t 3 ) or 
variations thereof. 

To facilitate computations in A we frequently employ plethystic or A-ring 
notation [33J3S]. This is most-easily described in terms of the Newton power 
sums 

p r (x) := x\ + x r 2 H-, r ^ 1, 

with generating function 

OO 

'E-M ; = yi =n t ^ 1 —• 

fS m 1 ~ zx ‘ 

The p r form an algebraic basis of A, that is, A = W[pi,p 2 ,...]. 

If x = (xi,x 2 ,...) we additively write x = x± + x 2 + • • • and to indicate the 
latter notation we use plethystic brackets: 

f(x) = f(x i,x 2 , ■■■) = f[x i +x 2 H-] = f[x\, f e A. 

The sum, difference and Cartesian product of two alphabets x and y are then 
defined as 
( 2 . 12 ) 

Pr[x+y]:=Pr[X ] + Pr [jf], Pr[x ~ y\ '■= Pr [l] - Pr (»), Pr[xy] = Pr[x]p r [»]• 

In particular, if x is the empty alphabet then p r [—y\ = — p r [y] and if y contains 
only a single letter, say y±, then p r [—yi\ = ~Pr[y l] = — y[- This should not be 
confused with p r (—yi) = (— y\) r ■ Occasionally we need to also use ordinary 
minus signs in plethystic notation. To distinguish this from a plethystic minus 
sign we denote by the e the alphabet consisting of the single letter —1, so that 


}{-x) = f(~x 1 ,-x 2 ,...) = f[ex !+ex 2 -\ -] = f[ex\. 


Hence 

Pr[ex\ = (-1 ) r p r [x\, Pr[-ex\ = (-1 Y~ l p r [x\ 

and 


f[x + e\ = /(—1, x±,x 2 ,...). 

For indeterminates a, b, t and / € A we further define /[(a — b)/(l — f)] by 


(2.13) 


Pr 


b I 


1 - t 


1 -t r 


and note that (a — b)/(l — t) may be viewed as the difference between the 
alphabets a(l + 1 + 1 2 + • • •) and 6(1 + 1 + 1 2 H— •), where a(l + t + t 2 H— •) is 
the Cartesian product of the single-letter alphabet a and the infinite alphabet 
1 + t + t 2 + • • •. Alternatively, (a — &)/(! — t) may be interpreted as the the 
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Cartesian product of a — b and 1 + t + t 2 + • • •. We can of course combine 
(12.12j) and (I2.13p . and for example 


Pr 


X + 


a — b 
1 -t 


= p r [x\ +p r 


a — b 

Ll -t 


For r ^ 0, the complete symmetric functions are defined by 
hr (x) := ^ 


and admit the simple generating function 


cr z x := 


j2 zr h r (x)= n 


r^O 


1 


1 — ZXi 


Since v h 2 (a;) = -p log cr z (x) it follows that 


(2.14a) 

(2.14b) 

(2.14c) 


oi[x + y\ = o-i[a:]o-i[?/] = J j 


i> 1 


(1 - Xi)(l - yi) 


r 1 <X\[x] T-r 

[x-y] = T = 11 


1 -Vi 


o-i [y\ 1 -Xi 


0i 


r a — b 
1 - t 


n 


1 

j.k 


01 [at k ] _ (6;t) c 


ai[bt k ] (a;t)oo' 


These three formulae allow various infinite products to be expressed in terms 
of symmetric functions. 

Finally, for F = Q oj q j is the F-algebra endomorphism of A given 
by m P a g e 312] 

, ^ r -l l ~ ( f 

Uq,tPr = {- 1 ) Y^V Pr ' 

Note that c o t , q = oj~1, and that plethystically 


(2.15) 


Uq,t f(x) = f 



1 ~g 
1 - t 



fe A. 


2.5. Macdonald polynomials. 

Let F = Q (q,t). The power sums p\ := n!=i Pa, may be used to define a 
q, f-Hall scalar product on A as [64] 


n 

(p\,p»)q,t ■= 

i=l 


1 — q Xi 
1 - f 
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where Z\ = Ili>i ■ The Macdonald polynomials P\(q, t ) 

are the unique family of symmetric functions such that [64] 

(2.16) P x (g, t) = m x + u Xfl (q, 

ti<\ 


and 

(-Pa( 9, *), P/x(9, = 0 if A ^ fi. 

Here the m x are the monomial symmetric functions, given by 


m\(x) = ^ x a 

a 


P\{x]q,t) 


with a summed over distinct permutations of A. It immediately follows that the 
Macdonald polynomials form a basis of A. When /(A) > n, P\(xi, ■ ■ ■, x n ; q, t ) = 
0 and {Pa(zi, ...,x n ;q, t)}i {X )^n form a basis of A n . 

The skew Macdonald polynomials P A / A1 (g,f) are defined by 

*)> t)) q ,t = {P\(Qj t), Pn(q, t)P v {q , 


and vanish unless /i C A. For q — t the Macdonald polynomials simplify to 
the classical Schur functions: P\/ M (t, t) = s A / M . 

For later comparison with the Koornwinder and (P, S ) Macdonald polyno¬ 
mials we remark that an alternative description of the Macdonald polynomials 
on n variables is as the unique family of polynomials (j2.16(1 such that [64] 


(Px,P,y,j = o if A 5^/1, 

where, for |g|, |i| < 1, (-, •)' t = 0 is the scalar product on F[x] = F[xi,..., x n ] 
defined by 


(/> 9)q,t : = j7A~ -v» f f(x)9(x *)A(x; q,t) — • • • —. 
y n!( 27 ri) ra y T „ aq 

Here fix -1 ) = /(xf 1 , ... ,x ~ 1 ) and A(x; q,t) is the Macdonald density 

(xi/xjjXj/xi; q)oo 


(2.17) 


A (x\q,t):= [j 




(tXi/xj, tXj/xi] q) c 


Below we list a number of standard results from Macdonald polynomial 
theory needed later. First of all, defining a second family of Macdonald poly¬ 
nomials Q\/fj,(q, t) = Q x /fj,(x; q, t) as 

(2.18) 

with b x (q,t) given by fj2.3|) . we have 


( 2 . 19 ) 


u, f Px(q,t) = Qx(t,q) 
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as well as 

This last equation is equivalent to the Cauchy identity 

P\(x-q,t)Q x (y;q,t) = 

1A , (x iyj -q) oo 
which we repeatedly require in the dual form 

n m 

(2.20) Y (-1) |a| P a (xi, ...,x n \q, t)P\>{y u ..., y m \ t, q) = JJ JJ(1 - x iyj ). 

A Cm" i= 1 j= 1 

We also need the g- and e-Pieri rules for Macdonald polynomials expressed 
in generating function form. First, in the g-Pieri case, 

(2.21) P^q, t) JJ ^ tx " = ^ a |A//i| <p A/M (g, t)P x (q, t). 

m [aXi ’ q)o ° 

Here the Pieri coefficient c p x /n(q,t ) = 0 unless X/y is a horizontal strip, in 
which case 



(2.22) <px/^(q,t) 


n 


(■ qt j ‘igk-Aj _ (g* j 

{V~ i+1 -, g) Al - Aj (P-i+1; g) w _ w+1 

x (t j - i+ 1 -g) Xi - H _ (t J '~* + 1 ;g ) w - Aj . +1 
(^ J_ h g)^-/*,- (g# -4 ; g) w -A J+ i ’ 


Similarly, the e-Pieri rule is given by 


(2.23) P lt {x: q, t ) JJ(1 + ax*) = Y ^) p a(x; q, t ), 

8^1 AD/8 


where C A / /t ((?, t) is zero unless A//i is a vertical strip, in which case [6U page 
336] 


(2.24) 


V>v„(gP) = n 


X _ q/M-Pjp-i-i 
1 — qt L i—Np~ i 


X — gAi A,, I 'J i +1 

1 — q^i~Pp~ i 


The product in the above is over all i < j such that A* = y r and Aj > yj. An 
alternative expression for is given by [6U page 340] 


(2.25) vy>fei, = nrr^ 

J - A w;g,*) 

where the product is over all squares s = (i,j) G y C A such that i < j, 
yi = A * and A' > /i). 
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For A a partition define 


(2.26) 


bTM 


l _ ga{s)^i(s )+1 
l — o a ( s )+ijd( s ) 

se\ se\ ^ 

a(s) even a(s) even 



Lemma 2.1. Let A = 2|~p/2] := (2|"/i 1 /2], 2|"/i 2 /2],...). Then 

C~ /2 (t-q\t ) 1 

j C^q^t) 6jr(g,t)- 

Proof. The product in (12.251) is over all squares s in p for which A and p 
have the same row but different column length. If A = 2|~p/2] then A is 
obtained from p by adding a square to each row of odd length. Hence in 
this case the product is over all squares s = ( i,j ) such that /i, and j are 
both even and such that there exists a k > i such that /!& = j — 1. For 
example, if /i = (6,4, 3, 3, 2,1) then A = (6,4,4,4, 2, 2) and the relevant squares 
contributing to n b\(s ; g, t)/b^(s\ q , t) are the ones marked with a cross in the 
two diagrams on the left of the figure below. Because marked squares s = ( i,j ) 
occur in even rows and have j even, they must have even arm-length. But we 
can include all other squares of A and p with even arm-length since their 
contributions to b\(s]q,t) and 6 M (s;g, t) trivially cancel, as indicated in the 
two diagrams on the right: 



Hence 




II Yl 

sex se/i 

a(s) even a(s) even 


l 

b^{s;q,t) 



X _ g2a(s)^(s)+l 

1 — g 2a ( s )+lth s ) 


1 

b,(q,ty 


where the second equality uses the fact that A is an even partition. By (j2.2[) 
we are done. □ 


Taking x = (aq,... ,x n ) and equating terms of degree \/i\ + n in (I2.23P we 
obtain 


P M (aq, ■ ■ ■, x n ] g, t) aq • • • x n = 'if[ fJl+1 n )/ ^q, t)P^ + i„(aq,..., x n ; g, t). 
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By (12.241) the Pieri coefficient on the right is 1 so that 

(2.27) P^x i, ...,x n ;q,t)x 1 ---x n = P fl+1 n(x 1 ,.. .,x n ;q,t). 

Closely related to the Pieri formulas is the branching rule |M, page 346] 

(2.28) P\(xi,... ,x n -,q,t) = t)P»(xi, ■ ■ ■, x n _i; q, t), 


where [6ll page 341] 

(2.29) /p(Q,t)=il>x' /ll '(t,q). 

We conclude the section on Macdonald polynomials with the principal spe¬ 
cialisation formula [M, page 338] 


(2.30) P x (l,t : ... y t n - 1 ;q,t) = P x 

2.6. Koornwinder polynomials. 


rl -t n i 
. 1 -t. 



f n(X) 

Cx(t;q,t)' 


2.6.1. Koornwinder polynomials. The Koornwinder polynomials pE3j are a gen¬ 
eralisation of the Macdonald polynomials to the root system BC n . They de¬ 
pend on six parameters, except for n — 1 when they correspond to the 5- 
parameter Askey-Wilson polynomials [3]. 

Throughout this section x = (ay,... ,x n ). Then the Koornwinder density is 
given by 


(2.31) A(x; q, t\ t 0 , h, t 2 , t 3 ) := 


fx± 2 - 


\q) c 


=1 EUo(^ ; q) 


n 




( x i x j ; q)o 

(txfxf-q) c 


where 


(®i ;?) oo := {xi,Xi 1 ; q)oo 

■ /Tfl • ( 'T* . . /.■ . /v. I I /v* . /v* I >y. I * 

■"j ' j i Hjoo • i A t A j j i •*' j ^ j i y Joo- 

For complex g, t, t 0 ,.. ., t 3 such that |g|, |i|, |t 0 |, ■ • •, 1^1 < 1 this defines a scalar 
product on C[x ±:L ] via 


(/>p)i" ) ito 1 ti ) t 2) t 3 : = / f( x )d( x 1 )A(x-q,t]t 0 ,t 1 ,t 2 ,t 3 )dT(x), 
J T n 


where 


dT(x) : = 


dxi day 


2 n n!(27ri) n ay 

Let IK = & n x (Z/2Z) n be the hyperoctahedral group with natural action 
on CfaA]. For A a partition of length at most n. let mY be the VF-invariant 
monomial symmetric function 


™*(x) '■= J2 xa 


a 
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summed over all a in the IK-orbit of A. In analogy with the Macdonald 
polynomials, the Koornwinder polynomials K\ = K\(x] q, t; t 0 , t 3 , t 2 , t 3 ) are 
defined as the unique family of polynomials in A BC ™ := such that [43] 

K x = mf + 

fi< A 


and 

(2.32) (K>,K^l Mlj2j3 = 0 if A# 

From the definition it follows that the K\ are symmetric under permutation of 
the t r . The quadratic norm was hrst evaluated in [23] (selfdual case) and [85] 
(general case). For our purposes we only need 


(2.33) 




n 


2 ;?)oo 

(?) t i ?)oo rio^r<s^3(^ r ^ s ^ , ?)oo 


known as Gustafson’s integral [32] , 

The BC n analogue of the Cauchy identity (12.201) . is given by [70, Theorem 

2 . 1 ] 


(2.34) 


E< 

Ac m n 


1 y xl K m n_ x (x) q, t; to, h, t 2 , t 3 )K y (y, t, q; t 0 , t 1: t 2 , t 3 ) 

n m n m 

=n n ( Xi + x ^ - y j - yj 1 )=n n ^ ri ( x - ^t) > 

i= 1 j =1 i =1 j =1 


where y = (y u ...,y m ) and (a - & ± ) := (a - b)(a - b x ). 


2.6.2. Lifted and virtual Koornwinder polynomials. The lifted Koornwinder 
polynomials K\ = K x (q, t,T;t 0 , t 1: t 2 , t 3 ) = K\(x; q, t,T]t 0 , t\, t 2 , t 3 ) are a 7- 
parameter family of inhomogeneous symmetric functions m- They are invari¬ 
ant under permutations of the t r and form a Q(q,t,T,to,ti,t 2 ,t 3 ) basis of A. 
For example, K 0 = 1 and 


K 1 (q,t,T- 1 t 0 ,t 1 ,t 2 ,t 3 ) = m, + 


1 — T 


(1 - f)(l - t Q tit 2 t 3 T 2 /t 2 ) ^ V t r t 


E 


ft Q tit 2 t 3 T 


-1, 


As a function of the t r the lifted Koornwinder polynomial K x has poles at 
(2.35) t 0 ht 2 t 3 = q 2 - x '-H l+x ':iT-'\ 


(hj) e A. 
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Importantly, according to m Theorem 7.1], for generic q , t, t 0 ,..., t 3 (so as to 
avoid potential poles) 


(2.36) K\{xf, ...,x±\ q,t,t n ;t 0 ,ti,t 2 ,t 3 ) 


K\{x i,..., x n ; g, t; to, £i, t 2 , t 3 ) 
0 


if /(A) ^ n 
otherwise. 


Let A be the completion of the ring of symmetric functions with respect 
to the natural grading by degree, i.e., A is the inverse limit of A n relative to 
the homomorphism p mjn : A m —>• A n (m ^ n) which sends m x (xi,... ,x m ) to 
m x (x i,..., x n ) for /(A) ^ n and to 0 otherwise. Then the virtual Koornwinder 
polynomials K x = K x (q,t,Q]t 0 ,t 1 ,t 2 ,t 3 ) = K x {x\ g, t, Q\ t 0 , t 1 ,t 2: t 3 ) (which 
are again symmetric in the t r ) form a Q(q,t,Q,to,ti,t 2 ,t 3 ) basis of A, such 
that for x = (x \,..., x n ) and A C m n , 

(2.37) K x (x- q, t, q m \ t 0 , t 1 , t 2 , t 3 ) = (xi • • • x n ) m K m u_ x (x ; q, t: t 0 , t 1: t 2 , t 3 ). 


When Q = 0 the virtual Koornwinder polynomials can be expressed in terms 
of Macdonald polynomials as [77, Corollary 7.21] 


K x (x ; q, t, 0; t 0 , h, t 2 , t 3 ) = P x {x ; q, t ) q )c 


i— 1 


{xl,q)c 


n 


(tXjXfq), 

{xiXj\q ) 0 


from which it follows that 


(2.38) 


lim (x 1 ■ ■ ■ x n ) m K m n_ x (x ; q, t; t 0 , t u t 2 , t 3 ) 

m—^ oo 


= P\(x-,q,t)Y[ 

i =1 


Yir=0^ rXi '> 

(xhq) oo 


n 




{tx i x j \q) c 
ix j , g) o 


The lifted and virtual Koornwinder polynomials admit a lift of the Cauchy 
identity (12.34)1 to A x <g) A y as follows [77] Theorem 7.14]: 


(2.39) y^(-l) |A| iC A (a:; t, g, T; t 0 , h, t 2 , t 3 )K x >(y ; q,t,T; t 0 , t lt t 2 , t 3 ) 

A 

= nd-^)- 

This may be used to derive the following symmetry relation for virtual Koorn¬ 
winder polynomials. 
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Proposition 2.2. The virtual Koornwinder polynomials satisfy 
K x (x-,q,t,Q-t 0 ,t 1 ,t 2 ,t 3 ) 


= K\(x] q,t, Qtoti/q; g/£ 0 , q/t i, t 2 , t 3 ) , 

{qxi/to.qxi/ti, g)oo 

Proof. We begin with (12.39ft and identify the product on the right as afy—xy]. 
Carrying out the plethystic substitution 

to - t t 0 1 1 — t/ti 

y ha y H-- 

y y 1-£ 1 -t 

and applying the symmetry m Equation (7.2)] 


(2.40) K x 


to — t/to 1 1 — t/t i 

s + — + — 


; g,£, T; £o,£i,£2j £3 

= K x (y ; g, t, Tt 0 ti/t; t/t 0 , t/ti, t 2 , t 3 ) 


we obtain 

y^(-l) |A| iC A (o;; £, g, T; t 0 , ti, t 2 , t 3 )K x >(y ; g, t, T£ 0 £i/£; t/t 0 , t/ti, t 2 , t 3 ) 

A 

(j'O'Eii ^1 ^)cx 


n 


(tXj/t 0 , tXifti, t) c 


XI (i -^?/j)- 




Here we have also used (12. 14cH to transform the right-hand side. After replacing 
(to,t!,T) ha (t/t 0 , t/t 1; Tt 0 ti/t) this is equivalent to 

^(-l) |A| /l A (a;; t, q, Tt 0 ti/t; t/t 0 , t/ti, t 2 , t 3 )K x >(y ; q, t, T; t 0 , £i, t 2 , t 3 ) 

A 

= TT tt (1 _ 

J-J- (t 0 Xj, tix*; t) c 


Ol 




Expanding the double product on the right by the Cauchy identity (12. 39ft and 
extracting coefficients of K x \y ; g, £, T; t 0 , ti, t 2 , £ 3 ) yields 


Jl A (x; t, g, Tt 0 ti/t; t/t 0 , t/ti, t 2 , £ 3 ) 


K x (x] t,q,T; £ 0 , £1, t 2 , £3) JJ 


»>i 


t ) 00 


By the change (£, g, T) ha (g, £, Q) we are done. 

2.7. Macdonald—Koornwinder polynomials. 


□ 
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2.7.1. Macdonald, polynomials on root systems. Below we closely follow the 
exposition in jSS] . 

Let E be a Euclidean space with positive-definite symmetric bilinear form 
(•, •) and R a root system spanning E. The rank of R is the dimension of E. 
All root systems will be assumed to be irreducible, but not necessarily reduced. 
The root system dual to R , denoted R v , is given by 

R v = {a v : a G R}, 

where n v := 2v/(v,v) = 2n/||u || 2 for v G E. 

A pair of root systems (R, S ) in E is called admissible if R and S share 
the same Weyl group W and S is reduced. Given such an admissible pair and 
a G A, there exists a unique u a > 0 such that u~ x a G S. Moreover, the map 
a H y u^a from A to S' is surjective (injective if R is reduced) and commutes 
with the action of W. Hence u a is fixed along Weyl orbits, and U 2 a = 2 u Q if 
a, 2 a are both in R. In the following we only need admissible pairs (. R , S) up 
to similarity, allowing for the scaling of the u a by a positive constant. The 
classification of admissible pairs then breaks up into three cases. 

(1) R is simply laced and S = R (and hence u a — 1). 

(2) R is reduced but not simply laced and S = R v . Unlike Macdonald, who 
normalises short roots of R to have length \/2, we take the length of the 
short root to be 1 when R = B n and y/2 in all other cases. Then the 
u a are 1 (long roots) or 1/2 (short root) when R = B n , 1 (short roots) 
or 2 (long roots) when R = C n , 1 (short) or 2 (long) when R = F 4 , and 
1 (short) or 3 (long) when R = G 2 . 

(3) R is the non-reduced root system BC n and S is one of B ri , C n . In 
the B n case we normalise S — B n C BC n = R and in the C n case 
S — C n C \R = |BC„. Then u a G {1, 2} for all a. 

For (A, S) an admissible pair of root systems of rank rwefixa basis of simple 
roots A = {«!,..., a r } of R, and write a > 0 if a E R is a positive root with 
respect to this basis. The fundamental weights A l5 ..., A r of R are given by 
H v , A j) = Sij. As usual we denote the root and weight lattices of R by Q and 
P respectively, and write Q + = Y^i= 1 an d P + = £T =1 Z^ 0 A* for the set 

of dominant (integral) weights. 

Let A be the group algebra over R of P with elements e A and A W/ the 
algebra of lU-invariant elements of A. A basis of A u ' is given by the monomial 
symmetric functions 

< = E e '‘- Ae - P +. 

with sum over the IU-orbit of A. 

The ( R , S ) Macdonald polynomials defined below depend on the variables 
q and t a , o> G A, such that t a is constant along Weyl orbits. Hence there is 
only one t a in case (1), two in case (2), and three in case (3). In each case we 
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write this set of i Q ’s by t. The generalised Macdonald density (compare with 
(12. 1 71) ) is then 


(2.41) 


A(?,() := 

aeR 


(f^ 2 e a ;g Ma )oo 

(tatla e Q ; q Ua )oo 


where t 2a '■= 1 if 2a ^ R. Assuming, |g|, \t a \ < 1 this defines the following 
scalar product on A: 

where integration is with respect to Haar measure on the torus T = E/Q y and, 
for / = /A eA , / := f\ e ~ X - The (R, S) Macdonald polynomials 

P\ A G P + then arise as the unique family of A "'-symmetric functions 


(2.42) P\{q,t) = mg + 

/i<A 

such that 

(P\, P/j)q,t — 0 if A ^ /J. 

The sum in (12.421) is with respect to the dominance (partial) order on P + 
defined by A ^ /i if A — /i G Q + . 

Below we are interested in the generalised Macdonald polynomials for ( R , S) 
one of (B n ,B„), (B n ,C n ), (C„,B n ) and (D n ,D n ). Moreover, in the Hall- 
Littlewood limit, q —> 0, (in which case the S dependence drops out) we 
also need R = BC n . In the following we assume the standard realisation of 
B„, C n and D n in M n (consistent with our normalisation in (2)): 

(2.43a) 


A = 

{<*1, ' 


= {ei 

— e 2 ,..., 

^n —1 

i €n 

}. 

R = 

B n = 

rW 

(2.43b) 











A = 

{<*1, • 

• • ? &n} ~ 

= ( e i 

— e 2 ,..., 

£n —1 £n 

.? 

-1 + c 

1 }, R = 

Dn, 


and parametrise the set of 

dominant 

i weights 

P+ 

as 




(2.44a) 

(Ai 

i 

to 

+ ••• 

+(A„_i- 


! + 

2A n A r 

n 

R = 

= B„, 

(2.44b) 

(Ai 

i 

to 

)> 

+ ••• 

+(An-l■ 


1 + 

AnAn, 


R = 

= C n , 

(2.44c) 

(Ar 

— A 2 )Ai 

+ ••• 

+ (A n _i - 

— X n )A n _ 

1 + 

( An—1 


R = 

= D„, 


where A is a partition in the case of C n and a partition or half-partition in 
the case of B n , D„ with the exception that for D n the part X n can be negative: 
—A n _i ^ X n ^ A n _iH Finally writing Xi = e~ Ei (for 1 ^ i ^ n ), we will denote 


2 The map A„ K > —X n corresponds to the Dynkin diagram automorphism interchanging 
Xji—i and A n . 
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the four families of interest by 

pf”’ Bn) (z;g,M 2 ), P^ M (x-q,t,t 2 ), P^ Bn \x-q,t,t 2 ), Pf"’ Dn) (x; q, t), 

where x = (xi,... ,x n ) and (f,f 2 ) := (t ai ,t an ) in the first three cases and 
t = t a i for D n . 

There are several relations between the polynomials of interest. For example, 
if A := (Ai,..., A n _i, — A n ) then [22], Equation (5.60)] 

(2.45a) P A (D ”’ Dn) (x;g,f) = P^ M ( X] q,t, 1) 

if /(A) < n and 

(2.45b) P^' Dn \x-q,t) + pf"’ D ">(x;g,t) = Pf"’ Bn) (x; q, t, 1) 

(2.45c) Pf n ’ Dn) (x; q, t ) - Pf ”’ D " ] (x; q, t ) = P^ffl (x; q, t, q 1 ' 2 ) 


x n ( x i 

i= 1 


■ 1/2 1/2 


*- /2 ) 


if A is a partition or half-partition of length n. Whence 

(2.46) P^’ Dn \x;q,t) = Pf"’ Dn) (x; g,t), x := (x 1; ..., x n _ 1; x- 1 ). 
Similarly, comparing the Koornwinder density (12.31 j> with (12.41 j> it follows that 

(2.47) p(c n ,B n )^ ^ = Rx ( x . q ^ t . ±g i/2 ; ±t V2^ 

(see also [22]). Although the (B n ,S) Macdonald polynomials are indexed by 
partitions or half-partitions they too may be related to Koornwinder polyno¬ 
mials [22] • Before describing this relation, we briefly discuss another family of 
polynomials incorporating both B n families. 


2.7.2. The Macdonald-Koornwinderpolynomials K\( X ] q, t, f 2 , f 3 ). Our descrip¬ 
tion of Macdonald polynomials attached to root systems is by no means the 
most general and modern setup, see e.g., [T6ll66LI89j . Beyond Macdonald’s orig¬ 
inal approach we have already covered the Koornwinder polynomials. Here we 
discuss one further family of B„-like polynomials which we shall denote by 
K\(x; q, t; t 2 , t 3 ). In the notation of [89] they correspond to the Macdonald- 
Koornwinder polynomials P/ of ['891 Definition 3.21] with initial data given 
by the quintuple D = (B n , A ,t,P,Q). Here A is the basis of simple roots of 
B n given in (I2.43al) . P and Q again denote the weight and root lattices of B n , 
and t stands for ‘twisted’. 

The polynomials K\(x] q, t; t 2 , t 3 ), where x = (xi,..., x n ) and A = (Ai,..., A n ) 
is a partition or half-partition, are B n -symmetric functions (in the sense of 
(12.421 ) such that 

(2-48) <Aa(x; q, t; t 2 , t 3 ), K^x; q, t; t 2 , = 


0 . 
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Here, for /, g £ A BCn , 


(2.49) 



f(x)g{x)A(x; q, t ; t 2 , t 3 ) dT(x) 


with 



In the notation of the previous section this corresponds to ( R , 5 1 ) = (B n , B n ) 
and 



where t = (t Ql ,t an ,t ari ) = (t,t 2 ,t 3 ). It thus follows that 



(2.50a) 

(2.50b) 


The next lemma shows that the K\(x] q, t; t 2 , t 3 ) can be expressed in terms 
of Koornwinder polynomials, allowing us to prove results for the former using 
the latter. 

Lemma 2.3. For A a partition or half-partition 
K\(x;q,t;t 2 ,t 3 ) 



A a partition 


otherwise. 


For t 3 = g 1 / 2 or t 3 = hq 1 ^ 2 this is equivalent to [22j Equations (5.50) & 
(5.51)]. 


Proof. The triangularity with respect to the B n -symmetric monomial symmet¬ 
ric functions is clear and in the following we show that K\(x\ q , t; t 2 , t 3 ) as given 
by the lemma satisfies (I2.48p . Viewing the integral on the right of (j2.49j) as a 
constant term evaluation, it follows that (I2.48p holds when A is a partition and 
p a half-partition. By (I2.32p with {foVi} = { — 1, — q 1 ^ 2 } it is also clear that it 
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holds when A and /a are both partitions. In the case of two half-partitions 
(K\(x; g, t; t 2 , f 3 ), K^x] q, f; t 2 , h))^. t2M 

= / K u (x]q,t- 1 -q,-q 1/2 ,t 2 ,t 3 )K UJ (x]q,t--q,-q 1/2 ,t 2 ,t 3 ) 


X 


nh. i/2 +^ i/2 ) h,im )< 


2=1 


(t 2 x*,t 3 xf;g) c 


n 


(Xj Xj ; g) c 
g), 


dT(x), 


where v A — (|) n and cn := // — (|) n . Recall that (1 — rt ± ) := (1 — m)(1 — u 1 ). 


Since 


and 


(w 1//2 + u 1 ^ 2 ) 2 = (1 + ?x ± ) 


-u- 




-gw 1 * 1 , — q 1 / 2 ^] q) c 


(-n ± ,n ± ;g 1/2 ) 0O = (rt ±2 ;g)oo 

the second line of the integrand is precisely the Koornwinder density 

A(x;g,t;-g,-g 1/2 ,f 2 ,t 3 ). 

Hence 


(K\(x; q, t’, t 2 , t 3 ), A; t (x; g, t; t 2 , 

(K v (x\ q, t; -g, -g i/2 , f 2 , t 3 ), K u (x\ g, f; -g, -g 1/2 , f 2 , h)) [ ^._ q _ q 1/2it2it3 - 
By (I2.32p this vanishes unless v = u>, i.e., unless A — n- □ 


That .R A _(i)n (x; g, f; —g, — g 1//2 , t 2 , t 3 ) H i (x^ 2 + x i 1 ^ 2 ) is the natural exten¬ 
sion of K\(x] g, f; —1, —g 1 / 2 , t 2 , f 3 ) to half-partitions A may also be understood 
from the point of view of virtual Koornwinder polynomials. To see this take 

(x; Q, t 0 , ti) = (xi,..., x n ; g m , -1, -g 1/2 ) 
in Proposition (12.21) . Then 


K x (x; g, t, g m ; -1, -g 1/2 , t 2 , t 3 ) 


A'a(t; g, t, g m 1/2 ; -g, -g 1/2 , t 2 , t 3 ) JJ(l + Xi). 

2=1 


Since the left-hand side of (12.371) is well-defined for A a partition and m a 
half-integer, we can use that equation to eliminate the virtual Koornwinder 
polynomials in the above formula. Also replacing m n — A by A this results in 


K\(x; q, t; -1, — g 1/2 , t 2 , t 3 ) = K x _ { i )n (x; g, t; -g, -g 1/2 , t 2 , t 3 ) JJ (xJ /2 +x i 1/2 ). 

%= i 
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2.7.3. Hall-Littlewood polynomials. The ordinary (or A n _i) Hall-Littlewood 
polynomials are defined as 



where A is a partition of length at most n, V\(t) := J([ i>0 (t; t) mi (A)/(l ~t) miW 
and mo(A) := n — l( A). They correspond to the Macdonald polynomials for 
q = 0, i.e., P\(x;t ) = P\(x‘,0,t), and for t = 0 reduce to the Schur functions. 

Taking q — 0 in the (R, S ) Macdonald polynomials of Section 12.7.11 yields 
the more general Hall-Littlewood polynomials of type R. (The root system S 
no longer plays a role when q — 0.) More simply, however, the Hall-Littlewood 
polynomials of type R can be explicitly computed from 



(2.52) 


The normalising factor W\(t) is the Poincare polynomial of the stabilizer of A 


in W. 


In order to show that our bounded Littlewood identities for Macdonald 
polynomials reduce to known results in the q = 0 limit (or in the statement of 
some new results that do not have a g-analogue) we need to consider (12.52(1 for 
R one of BC n , B n , C n , D n . As in Section 12.7.11 we express these four families 
using variables Xi,... ,x n and partitions or half-partitions A, rather than roots 
and dominant weights, and write P) (x\,..., x n \ q, t, i 2 , • • •, t r ), with r = 3 
in the case of BC n , r = 2 for B„ and C n and r = 0 for D n . In each case 
we again assume (12.43P and (j2.44jl and identify Xi = exp(—e*). As basis for 
BC n we take the B n basis f!2.43ap (as opposed to a C n basis) and identify 
(L*i,L* n ,* 2 aJ = (t, —^ 2 /^ 3 , ~H). Then (I2.52p takes the equivalent form 



with W the hyperoctahedral group and A a partition of length at most n. 
Alternatively (see e.g., [93]). 



(2.54) 
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For t — 0 this admits the determinantal form 

(2.55) Pf C " ) (i;0,f 2 ,t 3 ) = 

x det (x 7 Aj+j_1 (1 - t 2 Xi)(l - t 3 xf) - x^ 3+2n ~ 3 ~ l (xi - t 2 )(xi - t 3 )), 

where 

n 

(2.56) A c (t) := p(l-®?) Yl (xi-xj^XiXj- 1) = j det ^ (a^ -1 -a;- n_J+1 ) 

z=l 

is the C n Vandermonde product. 


Lemma 2.4. Let 

n 

(2.57) $(x]t,t 2 ,t 3 ) := JJ 

i= 

and m a positive integer. Then 

(2.58) 


(1 — t 2 Xi)(l — t 3 xf) J-J- 1 —tXiXj 


2=1 


1 - xf 




1 — XiXj 


pS l Cn \x-t,t 2 ,t 3 )= y ®(x £ ]t,t 2 ,t 3 )jj 

eS{±l} n 


X. 


-Sim 


i= 1 


Proof. By (12.511) and (12.571) . 

-A tt (! — t 2 Xi)( 1 - t 3 Xi ) 


E 


w&6 


W\ X 


n 


2=1 


—A 


1 - x] 

= $(x]t,t 2 ,t 3 ) y 

w€& 7 

= v x (t)®(x; t, t 2 , t 3 )Px(x~ 1 ;t). 


n 


(tXi 




(Xi 


VJ I X 
w£&n ' 1 

-1 


n tXi — Xj 


Xj X j 


Xj)Q- - tXiXj) \ 
Xj)(l -XiXj) ) 


Hence 

P? Cn \x-,t,t 2 ,t 3 ) = 1 - ^ $(a^;t,t 2 ,t 3 ).P.\(ar*;t). 

\t 2 t 3 ]t) n -i W £g{±1} „ 

The claim now follows from P m n(x\ t ) = nf=i and the fact that n — l( A) = 0 
for A = m n with m > 1. □ 


In the case of C n we can be brief. As in the q, t- case treated earlier, (t, t 2 ) = 
(t ai j t an ) and from the q = 0 case of Q2.50bD 


(2.59) 


p(Cn) 

- r A 


(x‘,t,t 2 ) 


= pP Cn) (x-,t,±t 1 2 /2 ) 

= P[ CM (x; 0, t, t 2 ) = K\ (x- 0, t- 0,0, ±4 /2 ) • 
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Accordingly, the t 3 = —f 2 case of (12.551) is a one-parameter deformation of the 
symplectic Schur function [5Hj 

(2.60) sp 2 x (x) : = -J- det {xA Xj+3 ~ l - x Xj+2n ~ 3+1 ). 

The Hall-Littlewood polynomials P^ n \x;t,t 2 ) are given by the f 3 = —1 
case of (12.53ft where A is now also allowed to be a half-partition. In that case 
V\(t) is as defined on page [24] but with J[[ i>0 a P r °duct over half-integers. By 
(I2.50p we of course also have 

(2.61) p( Bn \x-t,t 2 ) = P^ Bn) (x;0,t,t 2 ) = K x (x;0,t;t 2 ,0). 

When t = f 2 = 0 the B n Hall-Littlewood polynomials simplify to the odd 
orthogonal Schur functions [59] 

(2.62) so 2n+ i, A (x) := —det (a;r A ' +J-1 - x Xj+2n ~ J ), 
where 

n 

(2.63) A B (x) := TT(l-Xi) TT (xi-Xj)(xiXj - 1) = det (zj -1 -xf 1-3 ). 

i=l l^i<j^n 

The B„ analogue of Lemma 12.41 is as follows. 


Lemma 2.5. Form a positive integer, 

n 

P{™$(x;t,t 2 ) = ^2 &(x e ;t,t 2 ,-i) JJzL £im/2 . 

eG{±l}" i =1 

Finally, the D n Hall-Littlewood polynomials P^ Dn \x;t) are given by (I2.53P 
with (f 2 ,f 3 ) = (—1,1) provided we multiply the right side 2 when 1(A) < n 
and W is taken to be the group of even signed-permutations, i.e., W = & n K 
(Z/2Z) n W As in the B n case A can be a partition or half-partition. When 
t — 0 this yields the even orthogonal Schur functions (see e.g., [72] ) 


(2.64) so 2n ,x(x) : = 


where 


oa ( \ \ det { x i 3 ~ ’ " ~ + X i 

2Ad(x) V 1 V 


— det ( 




x *j+ 2 n—j—l _ ^,-Aj+J-lA 


(2.65) A D (x) := ]^[ (xi — Xj)(xiXj — 1) = § ^det (xj 1 + xf n 3 '). 

Again we have a simple analogue of Lemma 12.41 
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Lemma 2.6. For e = (ey, ...,£„) £ {—1, l} n Ze£ sgn(e) := JIILiO- Then for 
m a positive integer 

n 

p { ^yi(x-, t) = $ (^ £ ; !> - 1 ) II x 7 eirn/2 - 

ee{±l} n i=l 

sgn(e)=l 


2.7.4. Modified Hall-Littlewood polynomials. The simplest definition of the 
modified Hall-Littlewood polynomials is as a plethystically substituted or¬ 
dinary Hall-Littlewood polynomial: 


x 


(2.66) P' x (x]t) := Px Kll _ t 
where Q\(t) = b\(t)P\(t) and 


;t) and Q' x (x]t) := Q\ 


x 


1 -t. 


\t 


h(t)= n(MW 

i>l 

There are numerous other, more insightful, descriptions of the modified poly¬ 
nomials, none of which will be needed in this paper. We nonetheless mention 
one such description as it highlights the combinatorial nature of the modified 
polynomials and hence of our character formulas such as (11.41) . Let Tab(A,/r) 
be the set of semistandard Young tableaux of shape A and weight (or filling) 
//, and let c(T) be the Lascoux-Schiitzenberger charge statistic on Tab(A,/r) 
Then g9l|6l] 

Q'ix(t) = ^2 iC(T)s shap e(T), 

TGTab(-,/i) 

where s x (x) = ^Tab(A ■) °° T * s the Schur function. 


3. Virtual Koornwinder integrals 

For {/a} a basis of A n , A or A BCn and g an arbitrary element of one of these 
spaces, we write [f\]g for the coefficient c\ in g = ^ \C\f\ ■ Although typically 
/o = 1 we still write [fo\g to avoid ambiguity as to the choice of basis. 

Our approach to bounded Littlewood identities relies crucially on proper¬ 
ties of two linear functionals, denoted Ik and /j”' ) and referred to as virtual 
Koornwinder integrals, acting on A and A BCn respectively. Let / £ A. Then 
the virtual Koornwinder integral Ik is defined as m page 110; Definition 6] 

(3.1) I K (f;q,t,T]to,t 1 ,t 2 ,t 3 ) := [Ko(q,t,T-,to,ti,t 2 ,t 3 )]f 

where K\ is the lifted Koornwinder polynomial. Similarly, for / £ A BCn and 
x = (x 1: ...,x n ) m P a g e 95] 

(3.2) I < jf ) (f;q 1 t-,t 0 l t 1 ,t 2 ,t 3 ) := [Kq{x\ q, t; t 0 , H, t 2 , t 3 )]f. 
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By (|2.32j) and Kq = 1 it follows that 

(3.3) /£ } (/; q, t] t 0 , h,t 2 , t 3 ) = 

= -J-tt [ A(x; q, t; t 0 , t u t 2 , t 3 )f(x ) dT(x). 

\T J T" 

Also, by (12.36ft . for / G A and generic q,t,t 0 ,ti,t 2 ,t 3 

(3.4) iP (f(xf, ...,x„\q, t\ t 0 , ti,t 2 , t 3 ) = I K (f ; q, t , t n \ t 0 , h, t 2 , t 3 ). 
Remark 3.1. Invoking the ring homomorphism ip : A 2n —> A BCri given by 

f(m x (x i,..., x 2n )) = mx(xf,..., xp) 

(so that ker(^) = (e* — e 2n -j : 0 ^ i < n)), it will be convenient to extend Ip 
to also act on A 2n (or more simply / G A). That is, we set 


(3.5) iP (f-,q,t-,toM,t 2 ,t 3 ) := 


[K 0 (x- q, t; t 0 , t u t 2 , t 3 )]f(xf, ...,xp 

f 6 A 2n , (or / G A). 


Since for symmetric functions 

Ip • • •, x 2 n); q, t; t 0 , h, t 2 , t 3 ) = Ip (f(x f, ...,x±);q,t] t 0 , h, t 2 , t 3 ), 

we will often not distinguish between (13.2ft and (13.5ft and simply write 

Ip(f',Q,t)t o,ti,t 2 ,t 3 ). 


The reader is warned that for specialisations that hit the poles (I2.35jl of the 
lifted Koornwinder polynomial^ (13.4p should be treated with great caution 
as the right-hand side may not be well-defined. In such cases T needs to be 
specialised before the t r (or at least before some of the t r ). For example, if T = 
t n and {to,ti,t 2 ,t 3 } = {iljit 1 / 2 }, then the lifted Koornwinder polynomial 
K\ is ill-defined for all partitions of the form (Ai,..., Aj_i, l 2n_2l+2 ) where 
Ai ^ ^ Aj_i ^ 1 and 1 ^ i ^n + 1/2. Accordingly, for (13.4ft to hold we 

must first specialise T = t n before specialising the t r . For example, since 


K\ 2 (q,t,T;±l,±t 2 ) = mp - 


(1 T)(T/t + t) (f t 2 ) 

(i-t)(i+t)(t-ti(Tm 


(and Kq = 1), we have 


/ A '(mi2;g,t,T;±l,±f 2 ) 


(i-t)(i + t)(t-q(T/tn 


3 Since q 2 Xi 3 is a nonpositive integer power of q this can never happen when the product 
tot\t 2 t 3 contains a positive power of q. 
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This gives /&r(mi 2 (g, t, t; ±1, ±£ 2 ) = 1 which trivially agrees with 

q,t;±l,±t 2 ) = l£\l-,q,t-,±l,±t 2 ) = 1 . 

However, 

I K (mi 2 ] q,t,T; ±1, ±£ 1/2 ) = 0. 

For specialising in the ‘wrong’ order we can use [ 8 D| Lemma 5.10]. 

Lemma 3.2. For fixed n let to ■ ■ ■ t 3 t n ~ 2 = t k where k is a nonnegative integer. 
Then 

lim I K (f-,q,t,T]t 0 ,ti,t 2 ,t 3 ) 


T—H'- 




+ x f + ■■■ + x k +Y1 tr \ l^ r ',q,t'it/t 0 ,t/ti,t/t 2 it/t 3 y 

r =0 

Continuing our previous example we hnd 
Urn I K (f]q,t,T;±l,±t 1/2 ) 

T-*t x 7 

= | 4 t ) (/;g,£,±i,±t 1/2 ) + | 4 0 ) (/( ± 1 ); , lL±l±£ 1/2 )- 

For / = mi 2 , we have m] 2 (±l) = —1 so that this correctly gives 0 = | + |(—1). 


Lemma 3.3. For p a partition and generic q,t,t 2 ,t 3 

(3.6) I K {f[x + e\;q,t,T ; -t, -t l/2 , t 2 , t 3 ) = I K (f ; q, t, t 1/2 T ; - 1 , -£ 1/2 , t 2 , t 3 ). 

Proof. Let / e A. From definition (13.11) of the virtual Koornwinder integral 
and the symmetry (12.40P of the lifted Koornwinder polynomials we infer that 
(see also [771 Equation (T.4) J3) 


(3-7) I K (f 


to — t/t 0 t\ — t/ti 
x H- z -:-b 


1 -t 


1 - t 


; q-i t, T; t/to, t/ti, t 2 , t 3 ^ 

= I K (f ; q, t, tT/toti-to, h,t 2 , t 3 ). 


If we take {£ 0 ,H} = {—1, —t 1 / 2 } = {e^t 1 ^ 2 }, so that 

to — t/to ti—t/ti e — et et 1 ? 2 — et 1 ? 2 

H---;— = -T H---;- = £, 


1 - t 

this simplifies to (13.61) . 


1 - 1 


1 - 1 


1 - 1 


□ 


4 In [771 Equation (7.4)] the denominator term (1 — t) should be corrected to (1 — t k ). 
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In the remainder we consider several closed-form evaluations of virtual Koorn- 
winder integrals over Macdonald polynomials. We begin by recalling two 
known results: 


(3.8) I K (P,(q, t); q, t, T; it 1 / 2 , ±(gt) 1/2 ) 


= x{p' even ) 


(' T 2 ]q,t 2 ) u C v (qt;q,t 2 ) 


V ■■= {n'W = 


(qT 2 /t;q,t 2 ) u C v (t 2 ]q,t 2 )’ 

(where it 1 / 2 , i(gt) 1 / 2 is shorthand for t 1 / 2 , —t 1 / 2 , (gf) 1 / 2 , — (gt) 1 / 2 ) and 

(3.9) I K (P M (g, t); g, t, T; -1, -g 1 / 2 , -t 1 / 2 , -(gt) 1/2 ) 

r lVw , {T-,gV 2 ,tV% C~ (—g 1 / 2 ; g 1 / 2 , t 1 / 2 ) 

1 } (-qV 2 T/t 1 / 2 ] gi/ 2 , ti/ 2 )^ ^-(t 1 / 2 ; g 1 / 2 , t 1 / 2 ) ' 

, which for T = t n is known as the U(2n)/Sp(2n) vanishing 


The identity 

integral, was conjectured in m Conjecture 1] and proven in [81, Theorem 
4.1]. The identity (13.9p was first stated (up to a trivial sign-change) as the 
conjectural [ 791 Equation (5.79)]. By pBO] Theorem 8.5], which implies [ITS] 
Conjecture Q6], it now also has been proven. 

From a symmetry of the virtual Koornwinder polynomials, the virtual Koorn- 
winder integral satisfies the duality mi Corollary 7. 60 


lK{f-,q,t,T- 1 t 0 ,t 1 ,t 2 ,t 3 ) =i K (f 


- Ei ~ q ) 


t\i/2 1 - q 


1 - t 


x 


; t, q, 1/T; s 0 , si,S 2 , S 3 ), 


where s r = —{qt) l ^ 2 /t r . Applying this to (13.81) and then replacing (g, t, T, /i) by 
(t, g, 1/T,//) using (12.41) . (I2.5b|) . (j2. 15j) and (j2. 19j) yields the dual integral 
page 741] 

(3.10) 

j f td t * ^ T _L 1 _i_ + i/2\ , ^ O^gVW 2 C /2 {q-q 2 ,t) 

I K (K(q,t)-q,t,T;±l,±t !)= X {P even) ■ c^J) ' 

We need two variants of this for /// . 

For A a partition or half-partition of length at most n dehne 

(gP - * -1 , P -i+1 ; q^Xi-Xj 


(3.11) 


I in). 


{qp-pp-pq^Xi-x, 


It is important to note that A/ (q,t) depends on the relative differences be¬ 
tween the A i, and that for A a partition 

A (q; q 2 , t) 


(3.12) 


A?(q,t) = 


(qt n 1 :q 2 ,t)x C x (t;q 2 ,t) 


5 In [77} Corollary 7.6] ui qtt should be corrected to u) t , q - 
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Theorem 3.4. For fi a partition of length at most 2 n, let 

p (pl p2ni • • • > p2n—l p2ni 0)‘ 

Then 

I ( P ...,xpq,t); q, t; ±1, ±t 1/2 ) 

= (-iy 2 n Ip~ 1] ..., x±_ ls ±1; g, t); g, t; ±t, ±t 1/2 ) 

is even 

[0 otherwise , 

where /i/2 := (pi/2, /i 2 /2,...). 

Theorem 3.5. For i/ a partition of length at most 2n + 1, Ze£ 

= (z/i - z/ 2n+1 ,..., /y 2n - z/ 2n+ i, 0). 

Then 

I ( k {Pu(xf, ..., x±, 1; q, t); q, t; -1, t, ±t 1/2 ) 

= (F„(xf,..., x±, -1; g, t); g, t; 1, -t, ±t 1/2 ) 

J^/2 +1 ^(9) */ ^ eren 

[0 otherwise. 

Proof of Theorem 3.f. From (I2.27P we have 

, ■ • ■, xp g, t) = Pfi(xf, ...,xp,q, t) 

P^xf,xp v ±1; g, t) = (-1 Y^P^xf,xp v ±1; g, t), 

so that 

(3.13a) Ip (PPxf,..., xp g, t); g, f; t 0 , *i, * 2 , P) 

= Ip {Ppxf, ...,xpq,t)\ g, t; t 0 , t u t 2 , t 3 ) 

and 

(3.13b) Ip~ l) (PPxf,xp v ±1; g, t); g, t; t 0 , *i, < 2 , * 3 ) 

= (-l)^"/^ _1) ,..., x±_ l5 ±1; g, t); g, £; £ 0 , P, h, t 3 ). 

Since A^P(q,t) = A^(q,t), it thus suffices to prove that 


(3.14) /j? ] (F w (xf,.. ■, xp g, t); g, t; ±1, ±t 1/2 ) 

= /^ _1) (P^xf,..., ±1; g, t); g, t; ±1, ±t 1/2 ) = x(w even) ,4^ (g, t), 

for co a partition such that l(uf) < 2n. 
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Plethystically, for = {±1, it 1 / 2 } = {1, e, Z 1 / 2 , et 1 / 2 } we have 


\ t r — t/t, 

^ 1 - 

r=0 


t 


t £ 
+ 


1-t 1 -t 


£t t 1 ' 2 

+ 


1-t 


t 1 / 2 £fV 2 
+ ' 


et V 2 


1 - t 


— 1 + £. 


Hence, from Lemma [3721 with {Z 0 A 1 A 2 A 3 } = and / = P^(g,t), 

hm I K [P^(q, Z), q, t,T; ±1, ±t 1/2 ) 

= 14? (P^f, ■ ■ ■, xp q, t); g, t; ±1, ±t 1/2 ) 

+l 7 x _1) > ■ ■ ■, ®n-i> ±;L ; <?,*); f; ±*, ±t 1/2 ). 

By f!3.10p and (13.12j) the left-hand side is equal to x(p even) A^(q,t), which 
implies 

\Ik ] {PP x i, ■ ■ ■ , x n ; q, t)-,q, t; ±1, ±f 1/2 ) 

+ \ l{ K~ l) {P»( X 1 , ■ ■ •, ®n-i> ±x ; 9 , *); P ±*, ±^ 1/2 ) = x(a* even) A^g, t). 

Again using (13.13[) as well as 

y(/i even) A^(q,t) = x(/i 2 « even)y(/i even) A^(g, Z), 

and then renaming fa — fa — fa n as fa for 1 i ^ 2 n — 1, and fan as k, it 
follows that 

kjP (P u (xt, ■ ■ ■, x t ; q,t)\ q, t-, ± 1 , ±t lf2 ) 

+ \{~ l ) kl K~ l] , ■ ■ •, ^n-n ±i; g, *); q, *; ±t, ±t 1/2 ) 

= x(k even)x(a; even) A {2 p(q,t), 

for a; a partition of length at most 2n — 1 and k an integer. This implies 03.14H . 
completing the proof. □ 

Proof of Theorem \3.A Let z G {—1,1}. Since 


(3.15) Ip (P u (xf, ...,xp,Z] q, t)' q, Z; t 0 , t u t 2 , Z 3 ) 

= z V2n+1 I { p ( Pu{xf , ...,xpz; q, Z); q, t; t 0 , h,t 2 , Z 3 ), 

and App 1 \q,t) = Ap 2 +1 \q,t), it is enough to show that 

(3.16) Ip (P T (xf,..., xp z] q,t)] q,P ~z, zt, ±t 1/2 ) = y(r evenjA^+^g, Z), 

for r a partition such that Z(r) ^ 2 n. Since {Z 0 , Z 1; Z 2 , Z 3 } = {1, et, t 1//2 , et 1 / 2 } 
we have Y2l=o(^r—t/t r )/(l—t) = 1 — e. Lemma [3721 with f(x) = P u ([x+e\; q,t) 
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thus implies that 

hhn I K (P u ([x + e\ ; q, t ), q, t, T; 1, -t, ±t 1/2 ) 

Recalling Lemma 13.31 the expression on the left equates to 
lim I K {P v {q, t ), g, t t 1/2 T ; ±1, ±f 1/2 ) , 

T^t n v 7 

which by (I3.10P and (13.12)1 evaluates to x( iy even ) A^,™ + 1 \q,t). Putting this 
all together yields 

*e{—1,1} 

= xiy even) A^ 1 ] (q,t), 

which by (13.15)1 can also be written as 

§ zkl K ) { P r( x i,--^ x n^z;q,t)]q,t--z,zt,±t 1/2 ) 

= x(k even ) X {t even) A ( ^J l 2 + 1 \q,t), 

for r a partition of length at most 2 n and k an integer. This implies (I3.16p . □ 


Theorem 3.6. We have 


M 


( p2 'i q 2 11 ) 


fM/21 


(3.17) ¥ , {qtt y 

Proof. From (13.3p . definition (12.31)1 of the Koornwinder density and Gustafson’s 
integral (12.3311 it follows that 

1 — totit2tst n+l 2 


= I 


(n) 


K 


f{ x t, ■■■, x n) IIU “ toX ^ ] q ’ ^ to ’ * 2 ’ t3 J I [ 


2=1 


fctn^=l(l -^rP- 1 ) 


If / = Pn(q,t) we can use the e-Pieri rule (I2.23P to expand the integrand. 
Hence 


4 n) { p Mi *); f; ^o, *i, *2, * 3 ) = IJ 

2=1 


1 - tofif 2 f 3 t n+i 2 

ntiU-w 4 - 1 ) 


x 5Z(-*°) |A/#l| ^v,x(g>( p A(g,*); g, t; t 0 ,h, t 2 , t 3 ). 
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For (t 0: t 1 ,t 2 ,t 3 ) = (1,-1, t 1 / 2 , —t 1 / 2 ) this yields 


= \ ^(-1) |A// M/ M (g, t) 1 !? { p x(q, t); q, t; ±1, ±t 1/2 ). 

AD/i 

The integral in the summand evaluates in closed form by Theorem 13.41 In 
particular it vanishes unless (i) A is even or (ii) A is odd and l( A) = 2 n. Since 
iftx/n {q,t) is zero unless A//x is a vertical strip, this fixes A as A = 2f/x/2~| =: v 
in case (i) and A = 2|_/r/2j +l 2n =: uj in case (ii). Noting the three congruences 

\v\ = |co| = 0 (mod 2), |z///x| = odd(/r) = \p\ (mod 2), 


and 


we obtain 


uj/{i\ = 2 n — odd(/x) = \/i\ (mod 2) 


= ('0^(0', ^)-4S/2 ) (0' 5 i )- 4 i 2 /2 ) ^)) - 

We will now show that both terms on the right are the same, resulting in 
(3.18) {Pfx{q, t); q, t; q, —1, ±f 1/2 ) = (-1 ) M iH /lM (q,t)A^(q,t). 

First we note that since cu/2 = \jx/ 2j + (\) 2n and A^(q,t) depends on the 
relative differences of the //,, we have 

= ^Kj (?»*)■ 

Moreover, by (13.lip and vj 2 = [~/i/2], 


^S/2j(9^)=^ ) (9^) n 

l^i<j^ 2 n 
fii odd, fij even 


\ — qfti ft 3 £3 i 
1 — 


X 


n 

fii even, fij odd 


\ — qfti ft 3 i 1 

1 — qfti—ftjp—^ 


~Y q^i ft 3 ^ 

1 — qfti~ftj~^-fj~^ 1 

1 — qfti—ftj—ip—i 


But from (j2.24[) it follows that 


Vu/piq^) 


n 

l^i<j^ 2 n 
fii even, fij odd 


2 _ qfti 3 j^p * 1 

1 — qfti~ ftjp—i 


^ _ qfti ft3 

1 _ q^i-Vj-ip-i 
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and 


II 


l^i<j^ 2 n 
\ii odd, fij even 


^ A L j -fcj i 1 

1 — qto-Np-' 


q- 


A H AA? 


1 — q ^" 1 1 


so that 

establishing (13.1811 . 

Since u — 2 \n/ 2 ] is even we can use (13.1211 to write the right side of ()3.18(1 
as 

(-I)I-U' („ t) (t2 " ; q2 ' t] -> 2 'T/sfaqU) 

By Lemma [2.II this is also 

( i)M (* 2 ";gVW2 . i 


[qt 2n ~ l ] q 2 , t ) v /2 b ea (q,t)' 


Hence 


(3,9) if (P M , 1.= (-1)'"' ■ Vftjy 

Since both sides vanish if Z(/x) > 2 n this holds for all partitions /i. 

For fixed /j 

Ik{P t A<h t)\q,t,T\t 0 ,t u t 2 , t 3 ) 

is a rational function in T. By (13.411 and (13. 1911 . equation (13.1711 holds for 
T = t n for all nonnegative integers n. Hence it holds for arbitrary T. □ 

Our final virtual Koornwinder integral involves the Rogers-Szego polynomial 
(12.811 and does not appear to have a simple analogue at the q, t-lcvel. 

Theorem 3.7. For fi a partition of length at most 2 n, 

(3.20) 4 n) (P M (g,0);g,0;0,0,t 2 ,O) 

:= lim/^ ) (P M (g,Z);g,Z;0,0,f 2 ^3) = hA n) (-t 2 ,-t 3 ;q). 


t-> o 


Proof of Theorem \ 3. r /\ Let x — (aq, ..., x n ). By (j3.2[) equation (13.20)1 may also 
be stated as the rational function identity 

[Ko(x; q, 0; 0, 0, t 2 , t 3 )]P fl (x ± , q, 0) = hffi\-t 2 ,-t 3 ;q). 

Without loss of generality we may thus assume that \t 2 \, 11 3 \ < 1 below. 
Noting that 


HIo, 0; q) = x(A even), 
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the t 2 = ts = 0 case of (13.20b viz. 

(3.21) Ip^P^q, 0); q, 0; 0, 0, 0, 0) = %(// even), 

(with T = t n ) in the t —> 0 limit. 


follows from 

To include the parameter f 2 we use that (see (12.331) ) 


(u> 


(n) 

<?,0;0,0,t2,0 


= (l,l) 


(n) 

g,0;0,0,0,0 


and 


A (a; q, 0; 0, 0, t 2 , 0) = A(x; q, 0; 0, 0, 0, 0) JJ ± 

i=1 1^2> Q) C 

From (13.31) it thus follows that 

(3.22) fpfaq) :=4 n) (P Al (g,0);g,0;0,0,t 2 ,0) 


= / 


(n) 

K 


2 n 


P^(xf,...,x^;g,0) If 


l = \ (t 2 Xi ; q) 


-59,0; 0,0,0,0 . 


By the g-Pieri rule (12.211) for t = 0 this yields 

Ufaq) = ^2t% M <p v/ll (q, 0)4' 1 (Pv{q, 0); q, 0; 0, 0, 0, 0) 


lO/i 


^ /mI ^/m(9,0), 


v' even 
Z(i/)^2n 


where the second equality follows from (13.21)1 . Since <p v /n{q,0) is zero unless 
z///i is a horizontal strip and 1 / must be even, this fixes v as z/ 2 j_i = z/ 2 ; = /J 2 j-i 
for 1 ^ i ^ n. This is equivalent to 1 / — /i' + x(Hi odd), so that |u//r| is given 
by the number of odd parts of //, i.e., by odd(//). Hence 

U(t 2 ]q) = f 2 dd(/ ^ ) <p l ,/n(q, 0), 

with n fixed as above. From the expression for (p\/fj,(q,t) as given in (j2.22jl it 
follows that0 


(3.23) </Vm(9,°) = H 


(Q'i 


Mi+l 


1 


( 9 ; 9 )^- 


-n 

-Mi 


Ol L 


/ 4+1 


When z/ 2 j —1 = ^ 2 i = /x 2 i -1 this simplifies to ^/^(g, 0) = 1, since either zy+i = Hi 
or /y + i = //j + i. Hence 


(3.24) 




6 Alternatively, this follows from the Pieri coefficient (t) for Hall- Littlewood polyno¬ 
mials, thanks to yv/ M (q, 0) = ¥?'„, /At ,(0,g) = ^^ (o)■ 
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To also include the parameter b we proceed in almost identical fashion. By 


(1) l)g,0;0,0,t 2 ,t3 ~ (t f ■ n) ^<Z,0;0,0,t 2 ,0 

1 + 213 , Q)oo 


(n) 


and 


AO; 0, 0, t 2 , t 3 ; q, 0) = AO; 0, 0, t 2 , 0; q, 0) JJ 

2—1 


1 


and following previous steps, we obtain 

0(0,O; q) ■= I ( k (0( r h 0); q, 0; 0, 0, t 2 , t 3 ) 

= (OO; q) oo t l 2 /lll fu(t 2 ; q)<p v /p(q, 0) 

I'D /1 

= ( 00 ;g)<x> X] 

iO/i 

l(iy)^:2n 


Here the second line uses the definition of 0(0; g) as given in (13.22[) and the 
third line its evaluation (I3.24I) . To complete the proof we write z+ = /ij + 0 
for 1 ^ i ^ 2 n, and note that (see [96], page 822]) 


2 n 


2 — 1 


(3.25) odd(z/) = odd(/i / ) + ^~^(—l) t+1 Q. 

Once again using (j3.23j) we get 

U(t 2 , h\q) = (OO; q ) 0 o ^ dd(At} 7 \ II 1 

^ (g;g)fei ■ LA 


fcl,...,fc 2 n^0 

Summing over A+ by [ZZl Equation (II.1)] 

7 - 

£ 

o 


(-i) i+1 fe .fci 
2 fc 3 


iSsl 


Hi Hi +1 

0+1 


(?;?)*: 0;g)c 


for 0| < 1, 


and recalling definition (12.71) . we finally obtain 

2n— 1 2n —1 

0(0,0;g) =O kl(Al) n H mi{n'){hlh]q) n ^m i(M ')(00;g) 

2—1 
2 odd 

= h% n \-t 2 ,^t 3 )q). 


2—1 
2 even 


□ 
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4. Bounded Littlewood identities 

In this section, which is at the heart of the paper, we use Macdonald- 
Koornwinder theory and virtual Koornwinder integrals in particular to prove 
bounded Littlewood identities for Macdonald and Hall-Littlewood polynomi¬ 
als. 


4.1. Statement of results. 


4.1.1. q, t-Identities. There are five known Littlewood identities for Macdonald 
polynomials, the first four of which are due to Macdonald [Ml page 349]. By 
introducing an additional parameter a, they may be written as the pair 
Proposition 1.3] 

(4.1) 


£a° dd «&r(9,fTAfe9,«) = n 


(1 + axi)(qtxf, q 2 ) 


i =1 


Ob 2 ;? 2 ) 


TT {tXiXj\q) oo 
00 1 ?)°o 


and 


(4.2) ^a» dd < J A? (g ,i)P x fe g ,() = nht!i)«k Yl 


L± (axi\q) oo (xiXj\q) oo’ 


with Macdonald’s identities corresponding to a = 0 and a = 1. Here 
b °x:= b x (s\q,t ) and bf(q,t):= JJ b x (s\q,t ), 


sGA 

a(s) odd 


sGA 

l(s) even 


to be compared with (12.3p and (12.261) . The fifth identity was conjectured by 
Kawanaka. [32] and subsequently proven in m (see also ESI): 


(4.3) ^2b x (q,t)P x (x:q 2 ,t 2 ) = 

A 

where 


{—tXi, q) c 


n 


(' t 2 XiXj ; g 2 ) c 


L = ^ (Xi,q) oo f 1 „ (xiXf, g 2 )oo ’ 


km ■■= n 


sex 


1 _|_ ^a(s)^Z(s)+l 

X _ qa(s)+lfl(s) ’ 


In the following we generalise all of ( 14 . ID — (14.31) . 

For m a nonnegative integer and A a partition let 

i _ Jim— a/(s)+l fl'(s) 

I] t 

sGA ^ 

a/(s) odd 
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Note that b°^ m {q, t) — 0 if Ai > 2 m + 1 and that for A an even partition 

1 _ m—a , (s)-/-l'(s) 

(4.4) = b?( q ,t) n t ■ 

se A ^ 

cl'(s) even 

Our first bounded Littlewood identity generalises (14. ip . 

Theorem 4.1. For x = (xi,..., x n ) and m a nonnegative integer, 

^2a 0 ddW b 0 x * m (q,t)P x (x;q,t) = (^f[x™(l + ax t )^ P^P’ Bn \x; q,t, qt). 

A i = 1 


Macdonald’s identity (14.ip follows in the large-m limit by application of 
(E3HD and (1 Tm . 

When a = 0 the summand on the left vanishes unless A is even so thalQ 
(4.5) Y t)P x (x; q, t) = (x i • • • x n ) m p£n’ Bn \x- q, t, qt ). 

A even 


This is a q, f-analogue of the Desarmenien-Proctor-Stembridge determinant 
formula [T5 |i76l[88 j 


(4.6) 


52 s a (^> 

A even 
Ai^2m 


det 




{x{ 


J-! 


2m+2n-j+l 
X ,■ 


) 


ir=i(i-4)n 


1 ^i<j^n 


(Xi - Xj)(XiXj 


1 )’ 


which expresses the symplectic Schur function sp 2nm n(x) (times (x± • • ■ x n ) m ) 
in terms of Schur functions. Equivalently, (14 .6 p is a branching formula for 
the character of the symplectic group Sp(n, C) indexed by mA n in terms of 
characters of the general linear group GL(n,C). Like (11.21) . the determinant 
(14.61) is important in the theory of plane partitions and may be used to compute 
the number of symmetric plane partitions as well as the number of shifted plane 
partitions in B(n,n,2m) such that (in both cases) the parts along the main 
diagonal are even mm- 

Another notable special case follows when q = 0. For s G A C (2 m) n such 
that a'(s) is even we must have 2 m—a\s) ^ 2, which implies that b°£ m ( 0, t ) = 1. 
By (12.591) the q = 0 specialisation of (14.51) is thus 

(4.7) ^ P x {x-t) = {x 1 ---x n ) m P^\x-t 1 0). 

A even 
Ai^2m 


For positive m the right-hand side can be expressed in terms of the func¬ 
tion <3>(x; t, 0, 0) by Lemma [2.41 The resulting f-analogue of the Desarmenien- 
Proctor-Stembridge determinant is due to Stembridge [88]. Theorem 1.2] who 
used it to give new proofs of the Rogers-Ramanujan identities. We will see in 


7 By (12.271) . the same result may be obtained in the a —> oo limit. 
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Section [5721 that Stembridge’s method can be extended so that identities such 
as (14.7p yield Rogers-Ramanujan identities for certain affine Lie algebras 
for arbitrary N. 


For m a nonnegative integer and A a partition let 


k um) : = n 

se A 

l'(s) odd 


_ q m ~ a ' i 

X _ qm-a'(s)- 


n 

se x 

l(s) odd 


X _ gO(s)^(s) 

X — qa(s)+lfl{s)-l ' 


Note that bf m (q, t) = 0 if A 2 > m, which implies vanishing for Ai > m when 
X' is even. Our next theorem contains the first of two bounded analogues of 
(14. 2 p for a = 0. 


Theorem 4.2. For x = (xi,..., x n ) and m a nonnegative integer, 

(4.8) ^2bf. m (q,t)P x (x;q,t) = (x 1 ■ ■ ■ x n )^ P^f n \x] q, t, 1), 

where the sum is over partitions A C m n such that m,i(X) is even for all 1 ^ 


To see that (14.2p for a = 0 follows in the large-m limit we note that there 
are two types of partitions contributing to the sum on the left. 

Type 1 : Partitions A such that rrii( A) is even for all 1 ^ ^ m, i.e., A' 

is even. 

Type 2 : Partitions A such that rrii( A) is odd for i — m and even for 
1 ^ i < m, i.e., X' is odd and Ai = m. 

Macdonald polynomials indexed by partitions of Type 2 have degree at least 
m, so that their contribution vanishes in the large m limit. Hence we are left 
with a sum over partitions of Type 1, for which 


n 

se A 

l(s ) odd 


X _ q a ( s )t l ( s ) 

X — gtt(s) + l^(s)-l 


n 

sex 

l(s) even 


X _ q a l s )t l (s)+i 
X _ qa.(s)+ifi(s) 


bf{q,t), 


resulting in the a = 0 case of (14.2p . In fact, (I2.45P can be used to dissect (14.8p . 
resulting in two bounded Littlewood identities for D n , the first of which is our 
second bounded analogue of (14.21) for a = 0. 


Theorem 4.3. For x — (xi,..., x n ) and m a nonnegative integer, 
(4.9a) b im(q^) p x( x '^^) = ( x i ■ • •x n )^P ( ( | ) 7l 4 Dn) (x;g,t) 

A' even 

Y b °im(q^) P \( x ',Q,t) = i x l ■■■X n )^P^ Dn) ( X 'i ( h t )- 

X' odd 
Ai=m 


(4.9b) 
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Taking q — 0 in (I4.9aji yields 


m— 1 


(4.10) ^ Px&t) = (Xi ■ ■ - X n )™ P^l(x\t). 

X' even i =1 

Ai^m 

By Lemma 12.61 this is equivalent to (37) Theorem 1; Eq. (7)] of Jouliet and 
Zeng, which itself is a t-analogue of Okada’s determinant m Theorem 2.3 

(3)] 


J 2 sx ^ 

X' even 
Ai^m 


E 


eg{±l} 


deti 1 + ex™ +2n 3 *) 


2 n i<j(xi - Xj^xj - 1 ) 


For m a nonnegative integer and A a partition let 

^A;m(?A) ■— b x (q,t) ^ _ rn-a'(s)~lf-l'(s)+l ’ 

sG A 

l'(s) even 

We note that bf. m (q,t ) vanishes unless Ai ^ m. The next result is (jL3j) from 
the introduction, which bounds (14.21) for a — 1. 

Theorem 4.4. For x = (aq,..., x n ) and m a nonnegative integer, 

(4-11) ^2 b tm(Q^) p .= (Xi ■ ■ ■ x n )^ P^f n \x; q,t,t). 

A 

The q — 0 and t — q specialisations of (14.lip correspond to (I4.16p for t 2 = t, 
i.e., 

771—1 

II = (X 1 •••X n )^P ( ( |™2(x;t,t), 

A 2—1 
Ap^m 

and Macdonald’s determinant (11.21) respectively. 


Remark 4.5. Using (I4.9al) it is not hard to prove an identity that generalises 

(Q in full: 


A 

where 


bf■■= bf(q,t ) 


TT ^m/2 (atXj] q )oo 
y * (au; <?)oo 


p(Drc,,D n ) 

^(f) n 


(x]q,t), 


n 

sGA 


^_ q m ~ l 

X _ qtn—a'(s)—l^l'(s) ■ 


Z x (s) odd 

The largest part of A in the sum on the left is not bounded, and unlike (14.81) . 
(I4.9ap or (14. lip , this is not a polynomial identity. 
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For m a nonnegative integer and A a partition such that Ai m , let 

1 _ qm—a'(s)-j-l'(s) 

t) b \ (?) J. J. ^ i gm-a'(s)-l£/'(s)+l ’ 

sEA 

Our final result for Macdonald polynomials is a bounded analogue of Kawanaka’s 
conjecture (I4.3jh 

Theorem 4.6. For x = (xi,, x n ) and m a nonnegative integer, 

( 4 - 12 ) (FQ 2 ^ 2 ) = (x 1 ---x n )^ P^ Cn \x-,q 2 ,t 2 ,-t). 

A 

For t = — q this simplifies to (II.2ft and for q = 0 it is (14. 16ft below with 
(M 2 ) *-4- ( t 2 , -t), viz. 

m—1 

( 4 - 13 ) n ((r* t ’ t )rmw) p x( x >t i ) = ( X 1 ■■■x n )^P^n(x;t 2 ,-t). 

A 1=1 
Ai^m 

Assuming m is positive and rewriting the right-hand side using Lemma 12.51 
yields |33J Theorem 1] of Ishikawa et al. 


4.1.2. t-Identities. Our final two theorems do not appear to have simple ana¬ 
logues for Macdonald polynomials. 

Recall the generalised Rogers-Szego polynomials (12.81) . 


Theorem 4.7. For x — (x\,..., x n ) and m a nonnegative integer, 
(4.14) ^2 h\ m \t 2 ,t 3 -,t)Px(x-,t ) = (xi ■ ■ ■ x n ) m P^n Cn \x-,t,t 2 ,t 3 ). 

A 

Ai^2m 


This bounds [96], Theorem 1.1] 


(4.15) 


Y h x(, b 2 i 0; t)P x (x-1) = I j 


(1 - t 2 Xi){ 1 - t 3 Xi) 


2=1 


1 


xt 


n 


1 — tXiXj 
1 — X t Xj 


with h\(t 2 , t 3 , t ) given by (12.91) . Moreover, if we replace (t, t 2 , t 3 ) ha (0, —a, —b ) 
and use (I2.55H and H m (z ; 0) = 1 + z + ■ ■ ■ + z m , we obtain the following two- 
parameter generalisation of the Desarmenien-Proctor-Stembridge determinant 


y n 


2rri 1 a mi(A)+l _ ym.i( A)+l *"■» " ^ 


2m— 1 


n 


( ab ) 


m;( A)+l 


A 

Ai ^2m 


a — b 1 — ab 

2=1 
2 even 

deti<ij< n (atp^l + ax i)(l + bxi) - x 2m+2n ~ 3 ~ l (xi + a)(xi + b)) 


2=1 
2 odd 


nr=i(i-^)n 




(Xi - Xj) (XjXj - 1 ) 



















BOUNDED LITTLEWOOD IDENTITIES 


43 


Recall (12.101) . The t 3 = —1 case of Theorem 14.71 extends as follows. 
Theorem 4.8. For x = (x\,..., x n ) and m a nonnegative integer, 

(4.16) E h^ n \t 2 ]t)Px(x;t) = (xi • • ■x n )^P^l{x-,t,t 2 ). 

A 

Ai^m 

This is stated without proof in [9Bj. For (t,t 2 ) H> (0, — a) it simplifies to 
a one-parameter generalisation of Macdonald’s determinant (11.21) from the in¬ 
troduction: 

. j-r 1 — a miW+1 _ deti(^ _1 (1 + axi) - xf l+2n ~ J ~ 1 (x i + a)) 

Ai^m 

4.2. Proofs of Theorems I4.1H4.8L 

We begin by outlining the general strategy, which is to transform the prob¬ 
lem of proving bounded Littlewood identities into that of evaluating virtual 
Koornwinder integrals. 

Recall that if g G A n and {f\} is a basis of A n , then [f\\g is the coefficient 
of f\ in the expansion of g. Working in full generality, we would like to find a 
closed-form expression for 

(4 ' 17 h 

where m is a nonnegative integer. Since 

(xx-■ ■x n ) m K rn n(x;q,t-,t 0 ,t 1 ,t 2 ,t 3 ) = E u x m x (x), 

Ac(2m) n 

it follows that f^\q,t;t 0 ,ti,t 2 ,t 3 ) vanishes unless A C (2 m) n . 

Proposition 4.9. For m a nonnegative integer and A C (2 m) n , 

(4.18) f[ m \q,t;t 0 ,t 1 ,t 2 ,t 3 ) = (—1) |A| (Px'(t, q); t, q; t 0 , t u t 2 , t 3 ) . 

Proof. Let x = (x\,... ,x n ) and y = (y i,... ,y m ). According to the Cauchy 
identity for Koornwinder polynomials (12.341) 

(4.19) 

E (- 1 ) |A| ( a; i • • • x n ) m K rn n_x(x; q, t; t 0 , t 3 ,t 2 , t 3 )K x >(y, t, q; t 0 , t 1 : t 2 , t 3 ) 

ACm" 

= 0-1 [- xy ± ]. 
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If we expand the right-hand side in terms of Macdonald polynomials using the 
Cauchy identity (I2.20p this yields 

y (-l) |A| (a:i • • • x n ) m K m n_ x (x ; q, t ; t 0 , ti,t 2 , t 3 )K w {y ; t, q; t 0 , h,t 2 , t 3 ) 

A dm 71 

Ac(2 m) n 

Equating coefficients of P x (x ; q, t)K 0 (y ; t, q; t 0 , ti,t 2 , t 3 ) we fold 

[-Pa( a; g, t)] Oi • • • x n ) m K m n(a;; q, t; t 0 , *i, Cn <3) 

= (-l) |A| [Jl 0 (g; t, q; t 0 , p, t 2 , t 3 )]P x fy ± ; t, q), 

for A C (2m) n . Recalling (j3.2[) and 114. 17(1 completes the proof. □ 


Next we consider the problem of computing 

(4.20) f\ l \q-,t]t 2 ,t 3 ) \= [P x (x;q,t)](x 1 -■ ■x n ) m K m n(x;q,t-,t 2 ,t 3 ), 

where m is a nonnegative integer or half-integer and K x (x]q,t]t 2 ,t 3 ) is the 
Macdonald-Koornwinder polynomial of Section 12.7.21 


Proposition 4.10. For m a nonnegative integer or half-integer, A C (2 m) n 
and generic q, t, t 2 , t 3 

(4.21) f x n \qP\t 2 ,t 3 ) = (-l) w I K (P x ,(t,q);t,q,q m ; -1, -q 1/2 ,t 2 ,t 3 ). 
Proof. When m is an integer we simply have 

fi m \q,t',t 2 ,t 3 ) = f x "\q, t] —1, —g 1/2 , t 2 , t 3 ). 

By flUEID this gives 


f x ' l \qi h, h) = (-1 ) w lP ( P x ft , g); t, g; -l, -g 1/2 , t 2 , t 3 ), 


which may also be written as (14.2ip . 


To deal with the half-integer case we set k — m — 1/2 and replace m by k in 
flUmP , so that now y = (yi, ..., y k ). Multiplying both sides by J([” =1 (l + x i) = 
(7 1 [—£x\ , using that 

a 1 [-£x]a 1 [-xy ± \ = a^-ex - xy±\ = a[-xty* + e)], 
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and then expanding this using the Cauchy identity (12.201) we obtain 

n 

i=i 

x E (-l) |A| (a;i • • ■x n ) k K k n_x{x-,q,t-,t 0 ,t l ,t 2 ,t 3 )Ky(y,t,q;t 0 ,t l ,t2,t 3 ) 

AC k n 

= E + e];*,e)- 

Ac(2 m) ri 

After specialising {£ 0 ,£i} = {—O', —we can apply Lemma [2731 to rewrite 
this as 

E (- 1 ) |A| ( a; i • • ■ x n ) m K m n_ x (x] q,t;t 2 ,t 3 )Ky( y y;t, q-, -q, ~q 1/2 ,t 2 ,t 3 ) 

A Cfc" 

= E ( _1 ) |A|p A {x-,q,t)P y ([y ± + e];t,q). 

Ac(2m) n 

Equating coefficients of 9, t)K 0 (y, t, q\ —q, —g 1//2 , t 2 , t 3 ) yields 
(4.22) f { ™\q,t-,t 2 ,t 3 ) = (-l) |A| /jJ ) (P A /([ ? / + £];f,g);f,g;-g, -g 1/2 ,f 2 ,f 3 ) 

for A C (2m) n . For generic q,t,t 2 ,t 3 we can write the integral on the right as 
Ik{ p \‘ ([?/ ± + e] ; t, q) ; t, q, q k \ -q, -q 1/2 , t 2 , t 3 ), 
where now y — (yi,y 2 ,...). By Lemma [3731 this is also 

I K (P\'(t, q)] t, q, q m ; -1, ~q 1/2 , t 2 , t 3 ). □ 


We are now ready prove Theorems I4.1H4.8I 


Proof of Theorem f.l We hrst prove the a = 0 case, given in (14.5p . By defini¬ 
tion (I4.17P and equation (j2.47f) this is equivalent to proving that for A C (2m) n 

={ b r M T ven 

10 otherwise. 

From (I4.18P we have 

/<"•'(,, (;±, 1 / 2 ,±(,() 1 / 2 )=(-l)'Ur(Pv((. 9 )K. 9 ;± 9 1/2 .±( 9 «) 1/2 ). 

Taking (T, /i) = (f m , A') in (13. 8p and then interchanging q and t it follows that 
the virtual Koornwinder integral on the right vanishes unless A is even in which 
case it evaluates in closed form to 

(g 2m ; t , g 2 )(A/2)' ^(a/2)' ^ ^ 2 ) 


{q 2 m ~ l t ; t, g 2 ) (a/ 2)' C^y (<? 2 ; C <? 2 
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Using (12.41 we thus find 

/fV;±^±(^) 1/2 ) 


/g\ 1*1/2 (g~ 2m ;g 2 ,t) A/2 _ C x/2 (gt\ g 2 ,t) 
\t) {q x - 2m lt-,q 2 ,t) a/2 C~ /2 (q 2 ]q 2 ,ty 


for A even and zero otherwise. By (12.2p the right can be also be written as 
(4.23) /l m) (<?> t; ig 1 / 2 , ±(gt) 1/2 ) 



_ q2m—2a , (s)-^V(s) 

_ q2m—2a'(s) — l^/'(s)+l 


_ g2a(s)+l^./(s)+l 

1 — gf2a(s)+2^i(s) 


= n 

sEA 

a(s) odd 


_ g2m—a / (s)^.Z / (s) 

^ _ q2m—a'(s)—1-j-l' 


1 _ qa(s)-i-l(s )+1 
1 _ g«(s)+l^(s) 


Since A is even, odd arms-lcngths correspond to even arm-colengths. The 
product on the right is thus b^^q^t) in the representation given by (14.41) . 
completing the proof of (14.51) . 

To obtain the full theorem we multiply both sides of (14.5|) by nr=i(l + ax *)- 
By the e-Pieri rule (12,23ft we must then show that 


// even 


Because /i is even and t) vanishes unless A/p is a vertical strip, // is 

fixed as 

^ = 2LA/2J := (2LA 1 /2J,2LA 2 /2J,...), 
which implies that |A/p| = odd(A). We thus obtain 


t) = y' x//1 {q, t ) b™ m (q, t) 


with fi fixed as above. The m-dependent parts on both sides trivially agree 
since 

/a'(s),Z'(s) | /a'(s),Z'(s) ■ 

s£ A sG/x 

a ; (s) odd q/(s) odd 


It thus remains to show that 




Replacing (Aby (A', n',t,q), using 




K(q,t) 
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on either side, and finally appealing to PI page 341] 

we are left with 

= <P\/vi{q,t)Vjl{q,t) 

for ft! = 2|_A'/2J. This is P p. 351] so that we are done. □ 

Because they are simpler to prove than Theorems 14.21 and 14.31 we consider 
Theorems 14.41 and 14.61 first. 


Proof of Theorem 4-4 • If will be convenient to prove the claim with m replaced 
by 2m. After this change m is a nonnegative integer or half-integer. It then 
follows from (14.201) and (I2.50al) that we must prove for A C (2m ) n that 

/} m) (g,f;t,g 1/2 ) = bf. 2m (q,t). 

By Proposition 14.101 

f\ n \q,t]t,q 1/2 ) = (-l) lXl I K (Py(t,q)- 1 t : q,q m ;-l,t,±q 1/2 ). 


The integral on the right can be computed by Theorem 13.61 with (g,t, T, /i) 
(t, q , q m , A'), resulting in 




(g 2m ; t 2 , q)ix/2] _ 1 

(q 2m -H]t 2 ,q)w/ 2 \ b e y(t, q )’ 


Let v := |"A'/2] / 
right as 


(Ai, A 3 ,...). By (I2.4ap we can write the first factor on the 

/g\H (q~ 2rn -,q,t 2 ) u 
\t) (q^^/t^p 2 )^ 


By (12.2j) this is also 


n 

sGp' 


_ q2m—a , (s)-^2l , (s) 

^ _ q2m—a'(s)— l^-2/'(s)+l 


n 

sGA 

l'(s) even 


2 _ q2m—a'(s)-i-l'(s) 

^ q2m— a'(s)—1-f-l'’ 


Since under conjugation legs become arms and arms become legs, we further 
have 

b‘‘(t,q)bi(q,t) = l. 

Hence 

se A 

l'(s) even 


q2m—a' (s)^./ / (s) 


q2m— a'(s)— l£/'(s)+l 


= 6 A;2 rati,*) 


as claimed. 


□ 
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Proof of Theorem \f.b\ We closely follow the previous proof and again replace 
m by 2m. This time it follows from (I4.20p and (I2.50bj) that we must prove 

( 4 - 24 ) fl m) {< 1 2 , t 2 ; ~t, -qt ) = b~ 2m (q , t) 

for A C (2 m) n . By Proposition 14.101 

fx U) (? 2 , t 2 ] -t, -qt) = (-1 ) lxl I K (P x ft 2 , q 2 )] t 2 , q 2 , q 2m ; -1, -q, -t, -qt) . 

The integral on the right evaluates to 

(« q 2 m ]t,q) x > Cy(-t]t,q) 


■1) 


|A| 


-Q 


2m—1 


t;t,q) x' Cy(q;t,q) 


by (13.9(1 with (q,t, T, /i) ha (f 2 ,g 2 ,t 2m , A'). Also using 

rM 


/rv.cf) |A| ( (r2m;? ' i)A 


we find 


c x 


q 1 2 m /t;q,t) x C x (q\q,t) 


Equation (I4.24jl now follows by ([2421) . 


□ 


Proof of Theorem \f.S\ Again we prove the theorem with m replaced by 2m. 
ft then follows from (14.20)1 and (j2.50a|) that we must prove for A C (f2m) n that 
f{ m) (q, t. 1 , q 1 / 2 ) vanishes unless mi{ A) is even for all 1 ^ i ^ 2 m — 1 , in which 
case 

( 4 -25) 1W 1/2 ) = b°x. t2m (q,t). 

The problem with using Proposition 14.101 as in the proof of Theorem 14.61 is that 
the specialisation {^ 2 ,^ 3 } = {1 , g 1 / 2 } corresponds to one of the non-generic 
cases discussed on page [281 It would lead to 

(4.26) f { ™\q,t-,l,q 1/2 ) = (-l) ]xl I K (Py(t, q)\t, q, q m - ±1, ±g 1/2 ), 

where the integral on the right is not well-defined. It is still possible to use 

(14.26) 1 by interpreting the right in an appropriate limiting sense, but instead 
we proceed slightly differently. 

First, when m is an integer (14.21(1 simply says that 

/l m) (g,^ 2 ,t 3 ) = (-1 ) W I { K ) (Py(t,q);t,q]~l,-q 1 / 2 ,t 2 ,t 3 ). 

In this equation there is no problem specialising {£ 2 ,^ 3 } = {l,? 1 / 2 } so that 

fi m \q,t-A,q 1/2 ) = (-1 ) lXl I { K ) (Py(t 1 q)]t 1 q-,±l,±q 1/2 ). 

The right-hand side can be computed by Theorem 13.41 with (//, q, t, n) ha 
(A', t, q, m) so that 


(4.27) 


A ( 2m ) 

/<” V; 1 A /2 ) = 1 0 AV2 


(t, q) if X' is even 
otherwise, 
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where we have also used that | A| is even if X' = (A' — X 2m , ... , A / 2m _ 1 — X' 2m , 0) 
is even. 

When m = k + 1/2 is a half-integer, we use (14.22jl written as 
(4.28) 

= (-l) |A| 4 fc) (P A ,(xi,. . .,x k , -1 \t,q)\t,q\ -q, -q 1 / 2 ,t 2 ,t 3 ) 
instead of f!4.2ip . Specialising {£ 2 ,^ 3 } = {1 , g 1 / 2 } this gives 

1 ,q 1/2 ) = (“I ) W Ik\P\'( x u ■ ■ -,x k , “I ;t,q)]t,q] 1, -q,±q l/2 ). 

Now the right can be computed by Theorem 13.51 with (z/, q, t, n ) (->■ (A', t, g, k ). 
Since 2 k + 1 = 2m and |A| + \ 2 m is even if A' is even, this once again results 
ill {EH:'. 

To complete the proof we first note that A^^t, q) can be written as -Ajy /21 ?)■ 

Indeed, either X' is even, in which case (_A'/2J = X'/2 or X' is odd and Ai = 2m, 
in which case |_A'/ 2 J = A '/2 — (l/ 2 ) 2m . Since (t, q) only depends on the 
relative differences between the parts of A'/2 the change is justified. Denoting 
|_A'/2J by z/ we hnd that in the non-vanishing case, that is, when m*(A) is even 
for all 1 ^ i ^ 2 m — 1 , 

ft\q,t-A,q 1/2 ) = A$r\t,q) 

(g 2m ; t 2 , q) v t _ Cy(t;t 2 ,g) 

{q 2 m-H]t 2 ,q) v > C~,(q;t 2 ,q ) 

_ /g\H (q- 2 m -,q,t 2 )u _ C~(t-,q,t 2 ) 

\t) {q 1 - 2 m /t]q,t 2 ) v C~(q] q, t 2 ) ’ 

where the second equality follows from (j3.12[) and the last equality from (12.4p . 
Since v' = LA'/ 2 J we also have v = P_A'/ 2 J' which can be simplified to v — 
(A 2 , A 4 , A 6 ,...). Recalling f! 2 . 2 p . we obtain 


f { r 


(?,(; i,9 i/a )= n ( y 

sev ' 


^ _ qlm—a , {s)£ll , {s) 

_ q2m—a'(s) — l^-2/ / (s)+l 


X _ qa{s)-f.2l{s)+l 
X _ qa(s)+lf2l(s) 


To write this without reference to the partition v we consider both factors in 
the product separately. The first factor is trivial: 

^ _ q2m—a!(s)-^2l\s) _ _ q2m—a'(s)-i-l'(s)—l 


(4.29) 


n 


s£v 


^ _ q2m—a'(s)—l-f-21' 


n 

sE A 

l'(s) odd 


^ q2m—a'(s)—lj-l'(s) 


For the second factor we use that for A' even we must have A 2 i = A 2 i-i for all 
i. We can therefore redefine v as 


v := 


(Ai, A 3 ,...) 
(A 2 , A4,...) 


if X' is even 
if A' is odd. 
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But for such v 


(4.30) 


X _ qa(s)j.2l(s)+l 
XX 1 — q,a(s)+l£2Z(s) 


n 

sGA 


X _ g a ( s )f l (s) 

1 — q a ( s )+^th s ) 


in both cases. Combining H4.29j> and (I4.30P we obtain (I4.25p . 


□ 


Proof of Theorem \4-e\ When m is odd the result is completely elementary. By 
(12. 45b p and (I2.46P we can write the right-hand side of (14. 8 p as 


{x 1 ■ ■ ■ x n ) ” P ( ( m ) n r ( Dn) (x; q, t) + (x i ■ ■ ■ x n ) ™ (x; q, t). 

When m is odd the first term is a polynomial of even degree whereas the second 
term is a polynomial of odd degree. Since partitions A of Type 1 have even 
size and partitions of Type 2 have size congruent to m modulo 2, it follows 
that for odd m we may dissect (14.81) as in Corollary 14.31 

To prove the theorem for even m we closely follow the proof of Proposi- 
tion l4.10l In (14.19P we replace m by m— 1 =: k (we do not at this point assume 
that m is even) and multiply both sides by ]{[” =1 (1 — x i) = a i [~#(l + £)]- Then 
expanding the right-hand side in terms of Macdonald polynomials using (I2.20p 
gives 


n 

na^) 

i=1 

x Y (-l) |A| (xi • • • x n ) k K k u_ x {x\ q, t; t 0 , h, t 2 , t 3 )K y (y; t, q\ t 0 , h, t 2 , t 3 ) 

Ac k n 

= Y ( _1 ) |A|p A(^;g,t)T , A /([?/ ± + 1+ e];t,g), 

AC (2m) 71 

where y = (yi ,..., y k ). If we specialise {to, ti, t 2 , t 3 } = {±g, ig 1 / 2 } and apply 
Lemma 12.31 followed by (12. 50bp this leads to 


n 

n k i/2 - t 2 ) 

i=l 

Y (-l) |A| (a:i • • •x n ) m P ( ( ^fp i ) _ A (x;g,t,g 1 / 2 )Jl A /(t/;Cg; ±q, ±<? 1/2 ) 

AC k n 

= Y (- 1 ) |A|p A(^;g^)T + l + £\]t,q). 

AC (2 m) n 


X 
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Equating coefficients of P A (x; q, t)K 0 (y ; t, g; ±g, ig 1 / 2 ) and then replacing y by 
x on the right yields 

n 

(4.31) [P A (x; q, t)] {x\ ■ ■ -x n ) m P^ n _ f” } (x; g, t, g 1/2 ) JJ (x~ 1/2 - x] /2 ) 

1=1 

= (-i) |A| 4 m_1) (Pa'(4, • • •, x m~i , ±i; ^ ?); ±?, ±<? 1/2 ) • 

By the integer-m case of Proposition 14.101 
[P A (x; q, t)] (xi • • • x n ) m K m n (x; g, f; t 2 , t 3 ) 

= (-1 ) |A| 4 m) (-fV(f, ?); 9 ; -i, ^2, 4 • 

For {£ 2 ,^ 3 } = {1, <7 1 ^ 2 } this can also be written as 

(4.32) [P A (x; g, t)] (x,■■■ x n ) m P^ M (x; g, i, 1) 

= (-l)l A| 4 m) (Py(t, g); t, g; ±1, ±g 1/2 ) 

thanks to fl2.50ap . Taking half the sum of (I4.3ip and (I4.32p and recalling (I2.45p 
it follows that 

(4.33) [P A (x; g, t)\ (xi • • ■ x n ) m P,£ ri ’ Dn) (x; g, t) 

= |(-l) |A| 4 m) ( p A'(4, ■ ■ ■, ^4; t, g); t, q\ ±1, ±g 1/2 ) 

+ |(-l) |A| 4 m_1) (4v04, • ■ ■, ®m-i> ±;L ; 9 ); 9! ±9, ±4 2 )- 

Both virtual Koornwinder integrals on the right can be computed by Theo¬ 
rem EH Since 

y (A' even) + §(—l) A,2m j = y(A' even) 

for A' = (A; - X' 2m , A' 2m _ 1 - A' 2m , 0), we End 

[P A (x; q, t)] (xi ■ ■ ■ x n ) m P^”’ Dn) (x; q, t ) = x(A' even)H A , /2 (f, g). 

In the proof of Theorem 14.21 we have already shown that 

A\’/ 2 (t,q) = bf )2m (q,t ) 
for A' even (or A' odd and Ai = 2m). Hence 

[P x {x; q,t)](x 1 ■ ■ ■ x n ) m PSr ,Bn) {x-, q,t) = y(A' even )b°J. 2m (q,t). 


Replacing m by m/2 this proves (14. 9 aft for even rn. 
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For completeness we remark that the analogue of (14.331) for half-integer m 
is easily shown to be 

[P A (x; q, t)] (xi • • • x n ) m PSr’ Bn \x; q, t) 

= ( P x( x i, ■ ■ ■ , x k > - 1 ; q); t, q; 1, -q, ±q 1/2 ) 

+ h(-i) Wl K { p x( x t, ■ ■ ■, x k >!;?);C e; -i, 9, ±<? i/2 ), 

where k = m — 1/2. By Theorem 13.51 this again implies that 

[P A (x;g,t)](a:i---x ri ) m f , ^’ Dn) (a;;g,t) = x(A' even)frj 2m (g,t). 

Of course, as noted above, this result follows more simply by a degree argu¬ 
ment. □ 


Proof of Theorem \4- r \ By (j2.54[) and (I4.17P we must prove that 

(4.34) /! m) (0, t; 0, 0, t 2 ,0) = hf m \t 2 , t 3 ; t) 

for A C (2m) n . By (I4.18j) . 


(4.35) /f ) (0,t;0,0,t 2 ,t 3 ) = (-l) |A| /£° (P v (f, 0); t, 0; 0, 0, t 2 , t 3 ). 

The integral on the right can be evaluated thanks to Theorem 13.71 with (n, q, /T) 
replaced by (m,t, A'). Hence 

/| m) (0,t;0,0,t 2 ,t 3 ) = (-1 ) W h x (-t 2 ,-t 3 \t) = h^ m) (t 2 ,t 3 -,t), 

where the second equality follows from definition (12. 8 p and 


(-1)I A I = JJ(_i)"*W □ 

i^l 

i odd 


A proof of (I4.15p (the large-m limit of Theorem 14.71) using virtual Koorn- 
winder integrals is due to Venkateswaran [02] • Her approach, however, is not a 
limiting version of ours. Crucial difference is that Venkateswaran stays within 
the f-world, whereas we have applied the virtual Koornwinder integral (I3.20p 
over P\( 0, q). 


Proof of Theorem f.8. As in earlier proofs we replace m by 2m. From (I2.6ip 
and (I4.20p it follows that we must prove 


(4.36) = h i2m \t 2 ;t) 

for A C (2 m) n and m a nonnegative integer or half-integer. For m an integer, 
(I4.36P is the t 3 — — 1 case of (14.341) . and in the remainder we assume m is a 
half-integer. 

We will not apply Proposition 14.101 as it is not suitable for taking the q —> 0 
limit. Instead we take that limit in (I4.28p . Then 


/a (t) (0, t; t 2 , t 3 ) = (-1) |a| 4 } (P a ,(4, • • • — 1; t, 0); t, 0; 0, 0, t 2 , t 3 ) , 
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where k = m — 1/2. By the branching rule (12.28ft and relation (12.29ft this 
becomes 

/f } ( 0, t-t 2 , t 3 ) = £(-1)^(0, t)4 fc) 0); t, 0; 0, 0, t 2 , t 3 ). 

/j,CA 

The virtual Koornwinder integral on the right can be computed by Theorem 13. 71 
with (n,q,n) replaced by (.). Hence 

f^ n \0,t;t 2 ,t 3 ) = Y (- 1 ) H ^a//i( 0 ,t)h^ k \-t 2 ,-t 3 ;t). 

HCX 

Hi^2k 

We do not know how to evaluate this in closed form for arbitrary t 3 , but for 
t 3 — 0 it follows from (12. 8ft that 

Also using that (—1)^1 = (—i) odd (+) we find 
/< m) (0,f;«2,0)= £ 

HCX 

Hi ^2m—l 


Since "0^,(0 ,t) is the e-Pieri coefficient for ordinary Hall-Littlewood polyno¬ 
mials we have |6T], page 215] 


^(o,t) = Yl 

i^l 


X - A'. 


i+i 


[ A'-K 


5 

t 


Therefore 

4 m) ( 0,t;t 2 ,0) = Y ( _t2 ) 

hcx 

Hi ^ 2 m —1 

Writing /i' = A' — ki and using (I3.25P with (//, u, n) H > (//, A', m), we hnally 
obtain 


2m— 1 r 


odd(/x) 


n 

2=1 


A' - A' +1 

La'-K. 


2m—1 fn»(A) 

/f , (0.*l«2.0) = (-«2) Od<1(X) If E (-*2) ( - 1),fe 

i=l fc;=0 
2m—1 

= (-O 0ddW II ^.(A)(- 1 /*2;i) If 


rrii( A) 

. J t 
2m— 1 


2=1 
2 odd 


2=1 
2 even 


= fc< 2 ”>(f 2 ,-l;f) = fcr'(i 2 ;i). 


(2m), 


□ 


















54 


ERIC M. RAINS AND S. OLE WARNAAR 


B 


(i)t 
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^ CKQ CKl 


A 


(2)t 
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ol i ao 


A (2)t 

A 2n-la„_i 


1 


CKO 

If 


a (2) 

D 

A 
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( 2 ) 2 2 2 
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A (2)t 

A 2n a. 




ai ao 


Figure 1. The Dynkin diagrams of the “BC n -type” affine Lie 
algebras with labelling of vertices by simple roots ao,... ,a n and 
marks ao,... ,a n . 


5. Applications 

5.1. Character identities for affine Lie algebras. 

We will only define the bare minimum of notation needed, and for a more 
comprehensive introduction to the representation theory of affine Lie algebras 
we refer the reader to [151I61J. 

We will be concerned with affine Lie algebras g of “BC n type”, that is, 
B^, C n\ A 2 ^_i, A^ and D^ 2 ^, which are the algebras whose classical part 
(at least in standard labelling) is one of B n or C n . The relevant Dynkin 
diagrams are shown in Figure [5711 For Bn\ A^_i and A® we also use the 
nonstandard labelling of simple roots (indicated by the customary f) obtained 
by mapping ai ha a n -i for 0 ^ i ^ n. Apart from the simple roots ao,..., a n 
and fundamental weights A 0 ,..., A n we need the null root 5 given by 5 = 
with the cp the marks of g. We are interested in representations of 
g known as integrable highest-weight modules. If P + is the set of dominant 
integral weights P + = Xa=o A* then these modules are indexed by A e P + , 
and will be denoted by V (A) in the following. The character of V (A) can be 
computed in closed form by the Weyl-Kac formula: 


E™ G w s g n M e ™ (A+p) P 



(5.1) 


ch V (A) 
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Here W is the Weyl group of g, sgn(ro) the signature ofw £ W, p = A 0 +- • -+A n 
the Weyl vector, and mult (a) the multiplicity of a. In the denominator, the 
product runs over the positive roots of g. 

Below we prove combinatorial character formulas for 

(5.2) Xm(g) := e~ mA ° ch V (mA 0 ) 

for g one of B„\ Bn^, C„\ A^_i, A^l^ A^, A^, D^. Since the diagrams 
of Cn and D.| 2 |, are the same when read from left to right as from right to left, 
these two algebras occur only once in the above list. For A^l[, and D^, 
however, we obtain two distinct formulas, making a total of eleven character 
formulas. 

Recall that denotes a Hall-Littlcwood polynomial of type R. Also 
recall the definition of X in (11.51) . which may be written plethystically as 

1 _ t N 

X = (xi + x 1 1 H-b x n + x n l ) . 


We complement this with 
(5.3) 

X := (xf, txf,^-'xf, ., x±_ v tx±_ v ..., t^x^, 1, t, 

1 - t N 




= (xi + x 1 1 -t-b x n -i + x n \ + l) 


1 - 1 


Finally, in each of the formulas below mo(A) := oo. 

Theorem 5.1. Let 


(5.4) Xi := e -«i— -«n- i-«n/2 (1 t := e ~ s , 

and let m and n be positive integers. Then 

(5.5) Xm{ c£ } ) = liniJ^P^it 1 / 2 X;f,0) 

= tW 2 P' x (xf,...,x±;t), 

A even 
Ap ^2m 

(5.6) Xm( aS-O ={t'R 2 )oo lim t^ mnN2 P^Z*J(t 1/2 X;t) 

v 7 TV—>-oo ^ 2 > v 7 

m— 1 

= ^ tlM/2p x( X l,--^ X n^) II^ ;i2 ) m hA)/2 

A' even ^=0 

Ai^m 
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and 

(5.7) 


x4 A „) = lim t 3 ’””" P^S(t 1/2 X-,t,0) 

)V—> oo 1 2 J v ' 

= t lM/2p \(xf,..-,x±-,t). 


A 

Ai^m 


Theorem 5.2. Let 

Xi := e~ ai a n -i+(a n -i-a n )/2 ^ i ^ n), 
and let m and n be positive integers. Then 
(5.8) Xm (a£ } 1i) = (t; t 2 )oo lim t mnN2 {t l/2 X ; t, t ) 

AT—>-oo 

2m—1 


t := e 5 , 




1 [m i (A)/2] > 


A 

Ai ^2m 


2—0 


where the prime in the sum on the right denotes the restriction “rrii{ A) is even 
for i = 1, 3,, 2m — 1”. 

Theorem 5.3. Let 

(5.9) Xi := e~ ai (1 ^ i ^ n), 

and let m and n be positive integers. Then 

(5.10) Xm{^£ r ) = 




A 

Ai ^2m 


where t e and 

(5.11) Xm(D^i) = (-t 1/2 ;t 1/2 )oo lim t^ mnN2 (^ 1/2 -A; t, — 1 1/2 ) 

x 7 AT— >-QO ^ 2 ) 


' 2 ' 

m—1 


. 


»ii( A); 


A 

Ai^m 


2—0 


where t A 2 := e 5 . 


The identity (15.51) without the limiting expression in the middle is [5j Theo¬ 
rem 1.1; (1.4a)], (]5.7p . which is (11. 4p from the introduction, extends [5, Theo¬ 
rem 1.1; (1.4b)] from integer to half-integer values of m and (15. lip in the same 
way extends [5, Theorem 5.4], The identity 15.101 again without expression on 
the right, is [5] Theorem 5.3]. 

In each of the remaining formulas e _ " n is specialised. 
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Theorem 5.4. Let 

(5.12) Xi := - e -“*—(l^i^n-1), t:=e~ 5 , 

and specialise e -a " i-> —1. Then, for m and n positive integers, 

(5.13) X.„(A®») = Uni o «i'"' 2 "- 1 > ,v T^f_- ) r l (( 1/2 A|«,0) 

= Y 1 .!; f ) 

A even 
Ai ^2m 

and 

(5.14) Xm(B.Jj 1) ) = 

m—1 

= Y Y[(t-,t 2 ) mi{X ) /2 

X' even i =0 

Ai^m 

Theorem 5.5. Let 

(5.15) Xi := _ e - a ‘—(l^i^n-1), t 1/2 := — e -5 , 

and specialise e - “” (->• — 1. Then, for m and n positive integers, 

(5.16) x m ( D Si) = Jm^(i™( 2 ”- 1 > N2 P ( ( |;5--‘ir» , (« 1/2 A;i,0) 

= Y tWlp >( x i’ ••■.*Ti,i; f ). 

A 

Ai^m 


t := e 5 , 


Theorem 5.6. Let 

(5.17) X* := e —«<— -a n -i+(a n _i-a n )/2 (1 <C j ^ n _ 1/ 

and specialise e~ an (->• e _an_1 . T/jen, /or m and n positive integers, 

(5.18) Xm (B(‘») = 


- 2 > 

m—1 


Y t W2 Px( x t,---< x i-iO\t) n(- il/2 ; (1/2 ) 


rrii( A) 


A 

Ai^m 


z=0 


and 


(5.19) x»(ASli) = Jto«™ ( "- 1/2)wl Pl®2!;r„ 1> ~V 1/2 A'l«,0,-« 1 / 2 ) 

= X t (W+o«(A))/2 F , (lfi ... i:c ±_ iil . i) . 


A 

Ai ^2m 
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The rest of this section is devoted to a proof of these eleven formulas. 

Recall the Vandermonde determinants of type B n , C- n and D n given in f!2 .561) . 
(12T63D and flZ65l) . 


Proposition 5.7. For x = {x \,... ,x n ), m a positive integer and N a non¬ 
negative integer, 

L-t*' 


(5.20) ^ t^ 2 hf m \t 2 ,t 3 ;t)P x 


A 

Ai^2m 


X 


l-t 




_ ™ \mNj.mnN 2 /2 p(BC n jv) 

— i • •• x n ) i r m nN 

_ UUit^hx^/H^tu 


t l/2 


N 1 


X 


1 - t 
l-t 


; t, t 2 , t 3 


YTu^tXiXj-^N 


J| {tX i X j ]t) 2 N 




X 


A °^ (| 1/2 |2 1 X i ,t l/ % l Xj-t) ri 


r i,...,r n ^0 


A c (x) {t 1 l 2 t 2 x i ,t 1 l 2 t 3 x i -,t) r , 

TT {t- N Xi/Xj,XiXj\t) r . Nrj 

XX (t r r-/'T- rp .rp . • 


Remark 5.8. A more general hypergeometric identity than (15.201) holds, ob¬ 
tained by replacing 

i ,2 ( 1 - t Nl 1 - t N2 

X t-> t / I xi— —— + x 2 ——— H-h 

in (14.14p . From a hypergeometric point of view this more general identity, 
which on the right features the C n hypergeometric series 


1 - t 


N n 


X r 


l-t 


Y' A C (Xt r ) -A- (A 2 t 2 l Xj,t l l% 'XjlQr. 2 .mn 

2^ 11 (+H2+_„. +m+_ n ...+\ ( 2 I 3 ) {%it ) 


ri,...,r n ^0 


A C (x) || (t 1 / 2 t 2 X i ,t 1 / 2 t 3 X i -,t) ri 


x TT (t X '-r i /x r x i x j :t),, ^ 
iA(t x i/xj,t N ^ Xi x j-,t) ri 


is more natural. For our purposes, however, we do not require this greater 
degree of generality. 


Proof. Identity (I5.20p follows from il l. IIP by the substitution 
(5.21) 

X (->• t^ 2 (xi,Xit, . . . , Xi t* -1 ,., x n , x n t ,..., x n t iV ~ 1 ) = tf^x 


1 -t N 


l-t 
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(so that, implicitly, n K > nN ). The two left-most expressions immediately 
follow from (I5.20[) . but to show equality with the hypergeometric sum on the 
right some work is required. 

First we use Lemma [2.41 to trade the right-hand side of (14.14p for 

n 

Y $(T £ ;t 2 ,t 3 ;t) 

eG{±l} n i=l 

Next we observe that &(x £ -,t 2 ,t 3 ,t) contains the factor 

II ( l ~ tx T x 7) 

1 ^i<j^n 

which vanishes if there exists an i (1 ^ i ^ n — 1) such that 

Therefore, by the substitution (I5.2ip the summand vanishes if for some i, 
(£i,£i+ 1 ) = (1, —1) while (xi,Xi + \) is mapped to (x u t p , x u t p+l ) for some u and 
p. In other words, the only sequences £ that yield a non-vanishing summand 
are of the form 



ri times N — r\ times V2 times N — r 2 times r„ times N — r n times 


The r t are exactly the summation indices of (15. 20j) . The rest of the proof is 
tedious but elementary and left to the reader. □ 


Replacing 

(5.22) i4(ii,i/i,...,j m |/ n ) 

in (I5.20p (so that n i—>• 2 n), and then using ||5| Proposition 5.1] to take the limit 
Hi i —v x u 1 for all 1 ^ i ^ n, we obtain the following corollary of Proposition 15.71 


Corollary 5.9. Let m a positive integer, N a nonnegative integer and X the 
alphabet (11.51) . Then 


Y t w/2 hf m \t 2 ,t 3 -t)p x (x-t) 


A 

Aq ^2m 


= t mnN* p QS CpN)( t l/ 2 x . t ^ t3 } 


n 


(t 1/2 t 2 xf,t 1/2 t 3 xf-,t) N 


(■ txf 2 -,t) N 


i=l 


2N 

N 


n jtxf xf ; t) 2N 

(txfxf-t) 2 N 


t 1 


V A c(^ r ) TT {tVH^XutVH^Xi^r. 2 . 

1^ XXTT\ 11 _ , 1 / 9 , _ —— [*2*3) (Xit ) 


r&Z n 


A c (x) y (t 1 / 2 t 2 x i ,t 1 / 2 t 3 x i ]t) r . 


X 
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X 


(* Wjrin i2Nri 


i ;=1 ) L )ri 


Since 


lim P\{X\t) — P\ 

TV—>oo 


x t + ■ ■ ■ + x t 


;*) = p \( x fr-- x n',t), 


the above corollary is a bounded analogue of |5[ Theorem 5.2; (5.6a)], which 
states (without the second line) that 

(5.23) 

Y t w/2 hf m) (t 2 , t 3 ; t)P x (xf, 


A 

Ai^2 m 


= lim 


JV—loo m 

i n 


n 


(t 1/2 t 2 xf,t 1/2 t 3 xf]t) c 
± 2 . . 




n 




X 


E 


A c (xt r ) jj (t lp t 2 1 x i ,t lp t 3 1 x i -,t) ri 


-n\n (P 2 + r i\{m+n)n 


0 ht 3 t- n ) r '{xjf 0 


reZn A c (a;) (P/^x^P/HsXi-t)^ 

for m a positive integer. 

If instead of (15.22[) we make the substitution 

(5.24) x i y (xi,y u ... ,x n _i,i/ n _i,x n ) 

in (I5.20p (so that n H> 2n — 1) and then take the limit y l ha x~ x for all 
1 ^ i ^ n — 1 and x n —* 1 using [5, Proposition 5.1], we obtain a bounded 
version of [5| Theorem 5.2; (5.6b)jj 

(5.25) 


Y tW/2h \ m) (h,t 3 ;t)P\( x f ,• • •, x n—h !;*) 

A 

Ai^2m 

= Urn^ (A 2 X; t,U_,t 3 ) 

__1 _t~t (t 1/2 £2fff,* 1/2 %Eo*)oo 

~~ (t;t)^(p/ 2 f 2 ,m 3 ;t)oof = { (-^f;t) 00 (^± 2 ;t 2 ) 00 

x TT 1 V / a b (-sO 
ii<L ;<)oo V a b (-x) 

8 Taking x n -A t 1,/2 instead of 1 yields additional character identities to those of 

Theorems 15.11 and 15.61 
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X 


n 




“ = 7 (tV^XittVHaXiit)^ 


(-t 2 t 3 t 1/2 - n y\x 2 t ri ) {m+n - 1/2)ri 


where m is a positive integer and x n := 1. 

We are now ready to prove Theorems I5.1H5.6[ Our first two character for¬ 
mulas follow from (15.23(1 and (15.25p by letting t 2 and t 3 tend to zero. The 
hypergeometric sums on the right can then be identified with x m (C^) and 

/o\j. 

Xm(^2n ) respectively, by [5] Lemmas 2.1 & 2.3] and (5, Lemma 2.3] (which are 
simple rewritings of the Weyl-Kac formula for these two affine Lie algebras). 
In the latter case this identification requires the specialisation e~ an t—)■ — 1, 
corresponding to the condition x n := 1 in (I5.25p . In the t 2 ,t 3 — > 0 limit the 
left-hand sides simplifies since h x m \®i 0; t) = x(A even). We thus obtain (15. 5 p 
and (I5.13p . 

Next we specialise t 3 = — t 1 / 2 in (I5.23P and (I5.25p . Using 


(5.26a) 

(5.26b) 


A c (xt r ) T~r {-Xj\t) r . = A B {xt r ) 
A c (x) (-txi]t) ri A b (x) 

A B (~xt r ) -pi- (-Xj-t) ri _ A v(xt r ) 
A b (-x) (~tXi] t) n A D (a;) 


respectively, this yields 

(5.27) Y t]M/2h x m \h,-t 1/2 ;t)P' x (xf,...,x±]t) 


X 

Ai^2 m 


linp t mnN2 P^ N) (t^X-1, t 2 , -t 1 / 2 ) 
(t l/2 t 2 xf\t) oo 


N —^oo 

l 


n 


(*;*)£> ( tx ?; t )oo(tx?*;t 2 ) 00 (txfxf;t) oo 


X 




(■ m+n)n 


Y t w/2 hf m \t 2 , -t 1/2 ; t)P' x (xf ,..., x±_ x , 1; t) 

X 

Ai^2 m 

= (t^x-, t, « 2 , -U 2 ) 

_ _ 1 _TT (t l t 2 t 2 xf ; t) oo tt 1 

(t- 1)^- 1 ^ 2 ; ^)oo(i 1/2 t 2 ; t )oo (txf 2 -t 2 )^ {txfxf-1 ) 


and 

(5.28) 
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X 


£ 


rez n 


A D (^ r ) {tVH£xi,t) ri ^tl-ny^x^yrn+n-l/^ j ? 


A d (x) {t l / 2 t 2 Xi]t) ri 
where x n 1 in the second identity. Taking the t 2 —> 0 limit using 

h^\Q,b]t) = (-&)° dd U), 

/q\j. /q\j. 

and identifying the respective right-hand sides as Xm( A^p) and y rn (A^i,) 
by [5| Lemma 2.3] and Lemma [A. 3 1 results in (15. lOjl and (15. 191) . In particular 
we note that x n being 1 in (I5.28jl implies that we must specialise e _ “ n ha e""" -1 , 
see (1A.6H . In similar manner we specialise t 2 = t 1//2 in (15.27j) (considering (15.28ft 
does not lead to a character identity). Using (15.26bl) with x ha — x it follows 
from Lemma IA.3I that the right-hand side simplifies to 

t)oo Xm • 

By (12. 8 p the Rogers-Szego polynomial in the summand on the left becomes 

m —1 TTi—l 

h^ m \-t 1/2 ,t 1/2 ;t) = f odd(A)/2 Y[ JJ H mi{x) (~t]t). 


i= 1 
i odd 


Using (12.111)1) and (j2. 1 lcj) this yields 


2m —1 


Af“>(-f i/2 ,AA)= n<^ 2 


i= 1 
i even 


1 fm/21 


i— 1 


when rrii(X) even for all i = 1,3, ...,2 m — 1 and zero otherwise. Finally 
noting that (—t\t) Q O (f;f 2 )oo = 1, Theorem 15.21 follows. There is one further 
specialisation of (15.271) and (15.28j) that leads to character identities, namely 
t 2 = —1. We will consider this case as part of a more general treatment of 
(15T23D and (15^51) for t 3 = -1. 

Recalling that Theorem 14.81 extends the t 3 = —1 case of Theorem 14.71 to 
half-integer values of m, the t 3 = —1 specialisations of (I5.23jl and (I5.25j) lead 
to 


(5.29) 


t|A|/2/i A m) (^; t)P' x (xf, 


X 


lim t mnN2/2 P^l N (f 1/2 X; 1, t 2 ) 
(t^ 2 t 2 xf]t) oo 


TV—>• oo 

l 


n 


(M)So 7 = 1 (t 1/2 xf',t)oo(t 2 xf 2 ;t 2 ) 


n 


(Uy x 3 ; 


Ac (xt r ) t r {t 1/2 t 2 1 x i ; t) r . 

X r ^ n A c (x) f \ (P/ 2 t 2 Xi\ t) ri 


(-i 2 t _n ) ri (a ;^ ri ) (ro+2n)r</2 















































and 

(5.30) 
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t)P' x (xf, zj_i, 1; f) 

j™ ‘ m(2n - 1>NVl P!^-l (t 1,2 X; t,u) 


A 

Ai^m 


TV—>-oo 


l 




n 


(t 1 / 2 t 2 xf]t) c 


n 


i=l- 

x, ^b(— xt r ) -pj (■ t 1/ - J t 2 1 X i ;t) ri u + i/2-n\ r i(„2 + ri\(m+2n-l)n/2 


where x n := 1. If we now let t 2 tend to zero, use that h^ n \0',t) = 1 and 
further use [5] Lemmas 2.2 & 2.4] (see also fj5.34jl for the former) to identify 
the right-hand sides as x m (A^) and \m (D| 2 |,), we obtain (I5.7j) and (15 . 161) . 

/o\ 

We again note that the condition x n := 1 in (I5.30P implies that in the 
case we must specialise e -a " t->- —1. Two further cases, already mentioned 
in relation with (15.27P and (15. 281) . arise from (I5.29p and (I5.30P by specialising 
t ,2 = —t 1 / 2 . On the right we can once again use (I5.26p as well as [5], Lemma 
2.4] and Lemma [A.31 to recognise the hypergeometric sums as 

(-t 1/2 ;t 1/2 ) oo X m (0) 


( 2 ) 


for g = D n+1 
specialisation e” 


and Bl 1,f respectively. In the latter case we must assume the 


i—^ e 


&n — 1 


On the left we use (I2.10p and (12.1 lcll) to find 


m —1 

i=l 

completing the proofs of (15.111) and (15.181) . To prove our final two results 
we consider (15.291) and (15.301) for t 2 = 1. Then, by (14. 101) . we can add the 
additional restriction “A' is even” to the sum on the left and |r| = 0 (mod 2) 
to the sum on the right. Using Lemmas IA.2I and IA.1I this proves (15.6p and 
dEUD. 

5.2. Rogers—Ramanujan identities. 

Starting with the pioneering papers [53H58] . the link between affine Lie alge¬ 
bras and vertex operator algebras on the one hand and Rogers-Ramanujan 
identities on the other is by now well established, see also [2l fl3irnifI71fl8l[25l 
I261I38UTT1I98] . Nonetheless, examples of g-series (as opposed to combinatorial) 
identities that lift classical Rogers-Ramanujan-type identities to affine Lie al¬ 
gebra at arbitrary rank and level while still permitting a product form, are rare. 
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Recently Griffin et al. EH showed how to use combinatorial character identities 
of the type proven in Section 15.11 to obtain doubly-infinite families of Rogers- 
Ramanujan identities, including a generalisation of the Rogers-Ramanujan [82] 

/n\ 

and Andrews-Gordon [T1I28] identities to the affine Lie algebra . Following 
the approach of [31] we prove several new doubly-infinite families of Rogers- 
Ramanujan identities. 


(2) 

Theorem 5.10 (A^-Rogers-Ramanujan identities). Letm,n be positive in¬ 
tegers. Then 


(5.31) 


£® w/2 *Vi 

A 

Ai 


(9“;9' ! )4, '(r /2 ;<j“ /2 ) 

(?; «)5r 1 (« 1/2 ;9 1/2 )o. 


IRfaV 72 ) n WWA?”) 

i =1 l^i<j^n 


for k := m + 2n + 1, and 


(5.32) f |A| / 2+r,odd(A) P A (l,g,g 2 ,...;g 2n ) 

m 

(^X“V /2 ;^ /2 ) 


A 

Ai ^2m 


(i;<fc 1 (<z 1/2 ;<! 1/2 ) t 


n»w 


2=1 


*'g K/2 ) J] 




for k := 2 m + 2n + 1. 

Proof. To prove (15.31 jl we apply the specialisation 

F : C[[e _ “°,..., e -Qn ]] —>• C[[g 1/2 ]] 

given by 

(5.33) F(e ~ a °) = g 1 / 2 and F(e ~ ai ) = q for 1 ^ ^ n 

/o') /oN 

to the A), n ' character identity (15.7p . Since the the null root for A^ is given by 
5 = 2o 0 + • • • + 2a n _! + a n it follows from (j5.4(1 that 

F(xi) = g n “ m/2 (l^i^ n ) and F(t) = q 2n . 
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Hence 


f( W 2 P' x (xt,...,x±;t)\ 

Ai^m 


q nlXlp \{q ~ n+1/2 , q~ n+3/2 , • • •, q n ~ 1/2 ] q 2n ) 


A 

Ai^m 


£«W 2 q(l,.j 2 "- 1 ;, 2 ") 

A 

Kl^m 

^ 9 WTa(1, 9 , 9 2 ,... ;9 2 "). 


A 

Ai^m 


Here the second equality uses the homogeneity of the modified Hall-Littlewood 
polynomial and the the third equality follows from (I2.66P and 


/ 


1 + q H-b q 


2n-l 


i - q 


2 n 


= /[i + q + q 2 + •••], fe A. 


To apply F to the left-hand side of (15.7p we use that for arbitrary A 6 
parametrised as (compare with (I2.44bh ) 


A — coA 0 + (Ai — A2)Ai + • • • + (A n _i — A n )A n _! + A n A„ 
with A = (Ai,..., A n ) a partition and c 0 a nonnegative integer we can rewrite 

/o\ 

the Weyl-Kac formula for A 2n ; as [K Lemma 2.2], 

(5.34) 

e _A ch V (Ai =- 

fa nr=! 6{t 1/2 Xi] t 2 ) rii<i< 7 -<n V y (u/-'>.r,.r,: t) 


x 




Here n := 2n + c 0 + 2Ai + 1, sp 2nA is the normalised symplectic Schur function 
(lA.lj) and x ±,..., x n and t are defined by (I5.4|) . Using 


F [{^t)'loW°{ tl/ 2 x i\ t )^(x 2 i ]t 2 ) JJ XjOtXi/XjiXiXj-t) 

= (<?;5)Sv'0 1/2 ;9 1/2 )c 


i= 1 
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as well as the equations (12.601) . (1A.ll) . and appealing to multilinearity, yields 

q-Hicjip-j+1/2) 


F( e _A ch V (A)) = 


(g;fcV /2 ;g 1/2 )c 


X 


det ( 

Ci. n <Cn \ « ^ 




Q 


(K,r-\-\i—\j-\-j—l)(n—i+l/2)+nK,r 2 —2nr(\j-\-n—j-\-l) 


rGZ 


E" 


( K,r + Xi +A j + 2n — j +1) (n —i-\- 1 / 2)+n K,r 2 -\-2nr (A j -\-n— j + 1 ) 


Replacing (i,j) ha (n — j + 1, n — i + 1) in the determinant and then changing 
r ha —r — 1 in the second sum we get 


(5.35) F(e -A ch V (A)) 


1 



{XiQ 


K,r\2n—j 


5 


where Xi := q K / 2 * An “ i+1 . Again using multilinearity and recalling the B n 
Vandermonde determinant (12.631) . this may be rewritten as 


F( e _A chV(A)) 


1 

(<?; q) 2 o 1 (q 1/2 ] q 1/2 )oo 

n 

x A B (xg Kr ) n^~ i+1?2 ”^ r ^ + ^ /2 - 

rEZ n 2—1 


By the D^j Macdonald identity [62] in the form given by [S3 Corollary 6.2], 
i.e., 


ib 

J2 ^B{xq r )\[xl nri - i+1 q 2 < T i) +ril2 


reZ n 


2 — 1 


(Q-,Q)^ 0 1 i.Q 1/2 -,Q 1/2 )o 0 Y[d{x i - 1 q 1/2 ) JJ 9(x i /x jl x i x j ]q), 


2=1 


we obtain the product formula 

( q K -, q K )^\ q K/2 ] q K/2 )c 


F( e _A ch V (A)) = 




Y\d{q K/2 * A «-i+l ; g K /2^j 


2=1 


Q^q^n—j+1 ^n—i+l~\~j i qK i j ^n — i+1 ^n—j + 1 • q K ^ 




X 
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By 9(x; q ) = 9(q/x ; q) and a reversal of the products, this simplifies to 


(5.36) F(e~ A chV(A)) 


(T;T)S o 1 (T /2 ;9* /2 n A ., > i+ „- f+ i. */2, 
(91 9)ST 1 (') 1/2 ;9 1/2 )co fj w ’ 5 ' 


X 


II »(«■ 


Aj—Aj— i-\-j ^Ai+Aj +2n—i— j+2. 




For A = 0 and cq = m this gives the claimed right-hand side of (15.311) . 

To prove (I5.32p we this time apply the specialisation 

: C[[e _ “°,..., e - " 71 ]] —>■ C[[g 1/2 ]] 

given by 

(5.37) F\e~ an ) = q 1 ^ 2 and F\e~ ai ) = q for 0 ^ i ^ n — 1 

in the a!: 2 ^ character identity (15.101) . This implies the same specialisation of 
Xi,... ,x n and q as before, i.e., 

F\ Xi ) = q n - i+1 / 2 (l ^ i <c n ) and F\t) = q 2n , 


so that 


= ^ q xy2r . 


A 

Ai ^2m 


A 

Ai ^2m 


Moreover, since (I5.33j) and (I5.37P are compatible with the map from to 
A^y (corresponding to a reversal of the labelling of simple roots) we can again 
use (15.361) : 

Ft(e- mAo chy(mA 0 ))l A (2)t 

10— 

= F(e~ mA - chy(mA n ))| (2) 

1 y _A 2n 


(9“;9“Ko i (9“ /2 ;9'' /2 )c 

( 9 ; 9)ST 1 (9 1/2 ;9 1/2 )oo 

where k = 2m + 2n + 1. 


n»(9' +m ;9“ /2 ) n »(9 j "‘,9‘ +2 " 1 ;9 , ‘), 


2=1 


□ 
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(2 ^ 

Theorem 5.11 (D ^_j_ j -Rogers-Ramanujan identities). Form,n positive inte¬ 
gers and k := m + 2 n, 


(5.38) ^ q\ X \/ 2 P x (l,q,q\...-q 2n - 1 ) 

(q K ]q n ) 


A 

Ai^m 


)n 


( 9 ; 9)5r'(9 1/2 ;9)oo(9 2 ;9 2 


n< , (« i+( "' i) 'N”) n «(9 ) "‘,9 <+2 " i ;9 , ‘), 


2—1 




and 


m— 1 


(5.39) ^ ? |A|/2 ( n(-^^ n )- 2 w) p 4i,g,g 2 ,.--;g 2n ) 

A ' 2—1 

Ai^m 

(r;r)r 1 (r / 2 ;ii , ' /2 )o 




( 9 ; 9)So _1 (9 1/2 ; q)L(q 2 ; q 2 )^ i=1 

For n = 1 the first of these identities is the second equation on page 235 


of 

Sketch of proof. In the character identity (15. 16|> we carry out the specialisation 

F : C[[e-“°,...,e- Q "]] —► C[[q 1/2 }] 


given by 

F(e~ a °) = q 1/2 , F(e~ an ) = -1 and F(e~ ai ) = q for 1 ^ i ^ n - 1. 

Noting that F applied to (15. 15ft yields 

F{ Xi ) = q n (1 < i < n - 1), F(t l/2 ) = q n ~ 1/2 , 

and following the proof of (15.311) . it follows that the right-hand side of (I5.16p 
maps to the left-hand side of (15.381) . If we parametrise A e P + as (compare 
with f !2.44aj) ) 

(5.40) A = Co A 0 + (Ai — A 2 ) Ai + • • • + (A n _i — A n )A n _! + 2A n A„, 

with A = (Ai,..., X n ) a partition or half-partition and Co a nonnegative, and 
again follow the previous proof, we find 


F(e~ A chi/(A)) 


(q K \q K ) 


n 

oo 


(9; q)o o _1 (9 1/2 ;9)oo(g 2 ;g 2 )oo 


jQ 0(g A i+ n -*+( K + 1 )/ 2 - q K2 j 
2=1 


x Yl 0{q Xi ~ Xj ~ i+j , 


A j “t - Aj +2n—2— j~\~ 1 • 


;<f), 


where a := 2 n + Co + 2Ai. The only change compared to the proof of (15.31(1 is 
that we have used the Bn instead of D, 2 |, Macdonald identity. For A = mA 0 , 
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i.e., A = 0 and Co = m the above product gives the right-hand side of (15.381) . 
completing the proof. 

Similarly, to prove (I5.39P we apply the specialisation F to (15. lip , where this 
time 

F : C[[e _a °,..., e -Q "]] —>■ C[[g 1/2 ]] 

F(e ~ a °) = F(e ~ an ) = q 1 ^ 2 and F(e ~ ai ) = q for 1 ^ i ^ n — 1. 
Applied to (15. 9p this gives 

F(xi) = q n ~ i+1/ 2 (1 < i ^ n), F(f 1/2 ) = q n } 

so that the left side of (15. lip specialises to the the right side of (I5.39P . With 
the same parametrisation of A as in (15.401) and once more using the 
Macdonald identity, it follows that 


F( e -A chV(A)) 


(? 


k. n K,\n—l( rt K,/2. n K,/2\ 
H )oo W 5 H )c 


-q 11 ; q n ) 


( 9 ; ?)So _ 1 ( 9 1 / 2 ; 9 ) 


(q 2 -,q 2 )oc 


J\e(q Xi+n - i+1/2 -q K/2 ) 
1=1 


X Yl 6(q Xi -^- i+j 1 q Xi+ ^ +2n - i - j+1 -q K ) 


with k as before. For A = mAo, i.e., A = 0 and cq = m this gives the right-hand 
side of (I5.39p . □ 


Theorem 5.12 -Rogers-Ramanujan identity). Let m,n be a positive in¬ 
tegers and k := m + 2n — 1. Then 


A 

Ai^m 


m—1 


(5.41) £ g |A|/2 n(-T- ,/2 ;T- 1/2 )« w 


2=1 


(? K ;? 


K\n 
oo 


( 9 ; 9)5r 1 (9 1/2 i9 1/2 )oo fj, 






It follows from 


„n( A) m J * 

DM 2 \ 9 T-T q y2 ' 

A1 ,q,q = — = 11 




j_l (?) ?)m;(A) 


that for n = 1 (and after replacing q (->■ g 2 , A' t->- jV* and m;(A) n*) the 

theorem simplifies to Bressoud’s even modulus identity IM 


E 


9 


.NI+-+NI 


( n m -\-1 A m+1 ^2771+2. n 2m+2 A 
\H iH ? H i H )c 




(?; q) ni •••(?;?)n m _!(g 2 ;g 2 )r 


( 959)00 
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where Ni = rii + ■ ■ ■ + n m . From this point of view it is perhaps more natural 
to express the sum-side of (I5.4ip in terms of the Hall-Littlewood polynomials 
Q\(x;t ) = b x (t)P x (x;t): 

sr' q lM/ 2 Q\(i,q,q 2 ,-- • ;p 2 ) „_i / 2 

^ h{p)(-p-,p)x m p q 

Ai^m 

Remark 5.13. If after the substitution (15.24)1 we let x n tend to t 1 / 2 instead of 
1 , and then specialise (a, b) = (—t 1//2 , —1), we obtain an identity for y m (Bn' ) ) 
not included in Section 15.11 Upon specialisation this yields a companion to 
(15.41(1 as follows: 


A 

Ai^m 


m— 1 


E 9 W ni-C'tC'U 


2—1 


(q K ]q K ) 


n 

oo 


, 1/2im -n»(9 i_i/2 ;9-) n ww+’-v). 


For n = 1 this corresponds to pun] 

E 


,Nf+-+N^+N 1 +...+N rr 




(?; ?)n! g)n m _i(g 2 ;g 2 )r 


~2t71+1 ^2777+2. ^2771+2^ 

yv/j H _?J/_A 

(9;e)oo 


Sketch of proof of Theorem \5.1S[ We start with the Bn^ formula (15.18)1 and 
apply 

(5.42a) : C[[e _a °,..., e"“"]] —>■ C[[g 1/2 ]] 

(5.42b) F^(e _ao ) = q 1 ^ 2 and F^(e _Qi ) = q for 1 ^ i ^ n. 

Applied to (|5. 17(1 this yields 

F\ Xi ) = q n - { (1 ^ i < n - 1), F\t) = q 2n ~\ 

so that, up to a factor (—g” _1//2 ; q n ~ 1 / 2 ), the left-hand side of ((5.41(1 follows by 
application of Ff 

To obtain the product-form on the right we first consider the more general 
B^ specialisation formula 


F(e -A ch V (A)) = 


(q K ;q K )Zc(-q n 1/2 ]q n 1/2 ) c 

(r,qte 1 {Q 1/2 ;Q 1/2 )oo 


Y[0(q Xi+n ~ i+1/2 ;q K ) 


i —1 


d(q Xi ~ Xj ~ i+j , q Xi+x i + 2 n ~ i -i+ 1 - g K f 




X 
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where A and k are as in Lemma IA.ll and where F is the specialisation 

F(e~ an ) = q 1//2 and F(e~ ai ) = q for 0 ^ i ^ n — 1 

of Bn\ Proof of this result follows from the Macdonald identity. Aga: 
F^ and F are compatible so that 

Ft(e— Ao chy(mA o ))| 0=B (i )t 
= F(e~ mAn ch V (mA n )) | B (i) 

\ / I y— J->n 

w;?)So(r /2 ;?)c 


i= 1 


X 




where k — m + 2n — 1. Up to the factor (—g n_1 / 2 ; g n ^ 1 / 2 ) oo this is the right 
side of (15.4111 . □ 

/q\ 

Theorem 5.14 (A^Uj-Rogers-Ramanujan identities). Letm,n be a positive 
integers and k := 2 m + 2 n. Then 

(5.43) ^ g |A|/2 + (n-l/2)odd(A)p A(1; ^ . g 2n-l } 


A 

Ai ^2m 




K\n 
oo 


fa; ? 2 )oo 


n0(9 i +"/ 2 -‘;9“) n WD^ -2 ;?") 




and 

(5.44) 


( 2m—1 \ 

II (® 2 “; ) f\(i, 9, « 2 , ■ ■ ■: 9 2 ”) 

i=l ' 


A 

Ai^2 m 


( ' gK;gK )^( gK /2 ; gK ) 


2(g; g) 


n 

oo 


X 




—i i+j—2. k, 


q K ), 


i =1 




where the prime denotes the restriction m*(A) = 0 (mod 2) fori = 1,3,..., 2m- 

1. 

In the rank-1 case (15.4311 can also be written as 

nh(N?-\ -t"^2m+ n l+ n 3-t-f-n 2m -i) ( n m+l n m +1 „2m+2. „2m+2\ 

H \H i H 5 H > H /oo 


E 




(?; ?)m ■ ■ ■ (g; ?) 


™2rj 


(9;9)oo(g;g 2 )c 
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where IV* = n; + • • • + ri 2 m • Since jSSJ Lemma A.l] 


“1 u, 2 


a^aV 


<91 l)n • • • (9; «)«„ 

y • • ■C7 V?+ -- +J, "(-9 1/2 - w ‘»i/a2; 9 )jv, 

provided that 021 / 021-1 = 02/01 for all 2 ^ i ^ m, this may also be written as 

q Nf + ... + Nl(_ q l-N 1 . qj Ni ( q m+ 1 ; g m+l ; g 2m+2. g 2 m +2^ 


E 

ni,...,n m ^0 


(9; g)m ■ ■ ■ (9; g)r 


(9; 9)00(9; g 2 )c 


For m — 1 this is identity (12) in Slater’s list of Rogers-Ramanujan-type 
identities [57] . 


Sketch of proof. To first result follows from the principal specialisation EHE21 

ED] 


F: C[[e-“°,...,e-“"]]^C[[g]] 

F(e~ ai ) = q for 0 ^ i ^ n 

applied to the A^l, formula (j5. 19[) . Since the principal specialisation does not 
distinguish between A^l, and A^_ 1; we can use the general A^., principal 
specialisation formula [521160] 


F( e _A chR(A)) 


(q K -,q K )o o 

(9; 9)So(9; 9 2 )oo 


J j6(q Xi+n - i+1 -q K ) 
2—1 


X 


II 


A i —A j —2 -\-j \i+\j+2n — 2 — j +2. n 


,9 


;9 k ), 




where k = 2n + c 0 + Ai + A 2 and 


A — coA 0 + (Ai — A 2 )A! + • • • + (A n _i — A n )A n _! + A n A n 

for Co is a nonnegative integer and A = (Ai,..., A„) a partition. Taking Co = 0 
and A = m n gives the right-hand side of (I5.43j) . The left-hand side follows in 
the usual way, noting that 

F(xi) = q n ~ t+1 (1 ^ i ^ n — 1) and F(t) = g 2n_1 . 


The identity (15.441) follows from the specialisation F applied to the A^l x 
formula (15.81) . where now F stands for 

(5.45a) F : C[[ e - Q °,..., e“ a "]] -A C[[q]] 

(5.45b) F(e -Qi ) = q for 0 ^ i ^ n — 1 and F{e ~ an ) = q 2 . 
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According to (lA.fift this yields 

(5.46) F(xi) = q n ~ l+l ! 2 (1 ^ i ^ n) and F(t) = q 2n , 

which we should apply to the A ^-i character given in f 1A.7jl . Unlike the pre¬ 
vious cases, the steps required to obtain the product form are slightly different 
to those in the proof of (15.311) . and below we outline the main differences. 

From (I5.46p , the D n Vandermonde determinant and multilinearity, it follows 
that 


A^DlTt- 1 ) 


n x ^ r i—i+^t^ Kr i — ( n_ i) r ! 


i— 1 


det ( 

V rGZ 


r (rer — i+J) (n—i+1 /2')-\-nKr 2 — 2nr(n—j ) 


^^_ ^Vq(K, r —i—j+2n)(n—i+l/2)+nK,r 2 +2nr{n—j) 


r€Z 


After interchanging i and j and negating r in the first sum, the right-hand side 
becomes 

det ( \W —l) r g 2n K0 +Kr / 2 +( 2 ™--;+i)(ri-i) 
x rez 

X ^U r+n_ d(i- 1 ) _|_ q(nr+n-i)(2n-j) 



det 


'^^( K —\y x ^ nr ~ i+1 q 2nK ^) +Kr/2 [{xiq Kr y~ l 

r^Jj 


( x t q 


\2n-j 


7 


where Xi := —q n ~ l . Up to the change q K / 2 t—>■ q ~ K / 2 , the above determinant is 
the same as the one on the right of (j5.35j) . From here on we can thus follow 
the previous computations to find 


/ n 

FI 2 ^ A D (xt r ) JJ(-1 yi x p- i+1 t^-( n - 1)ri 

' rGZ n i= 1 

n 

= (V; 9X(-<z“ /2 ; q'U ]f ,“) 

We conclude this section with two remarks. First of all, we have not con¬ 
sidered the specialisations of (15.5ft and (15.13ft as the resulting and 
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/ o\ 

identities were already obtained in {3T|, the A^ case corresponding to a gen¬ 
eralisation of the Rogers-Ramanujan and Andrews-Gordon identities for odd 
moduli. We have also omitted the specialisation of (15.61) and (15.141) . but for 
different reasons. The “right” substitutions on the combinatorial sides would 
be Xi ha g n -*+V 2 ; (1 ^ ^ n), t o t 2n and ay ha q n ~ l+l (1 ^ i ^ n — 1 ), 

t ha t 2n ~ l respectively. This corresponds to the specialisations 

F(e~ a °) = q 2 and F(e~ ai ) = q for 1 ^ i 

for A S-i> and 

F(e~ ai ) = q for 1 ^ i ^ n — 1 and F(e~ a ° ) = q 2 , F(e ~ an ) = —1 
for B ■ However, F(e~ mA ° ch V (mA 0 )) does not factor for such F. 


5.3. Kaneko—Macdonald hypergeometric series. 

Kaneko-Macdonald-type basic hypergeometric series are an important gener¬ 
alisation of ordinary basic hypergeometric series to multiple series with Mac¬ 
donald polynomial argument. They have been extensively studied in the liter¬ 
ature, see e.g., jU|39lll0l[50l[671[771[78l[83l|95l|97], and are particularly useful for 
computing Selberg integrals and constant term identities. 

For x = (xi,...,x n ) the Kaneko-Macdonald basic hypergeometric series 
r+1 $ r is defined as [39|[67J 


r+1 


<f> 

r 


Qj \ ? ? CL r -|_i 

bi,...,b r 


]Q,t’,x 



(fll, . . . , ®r-1-1) ^)a 

(b 1 ,...,b r -,q,t) x 


t n( - x) P x (x- q, t) 
C x {q] q,t) 


For our purposes it suffices to consider the principal specialisation 


i<f> (n) 
r+1 r 


? &r+1 
b\i • • • 5 b r 


;q,t;z 


r+l + 


E 

A 

l(X)^n 


-,q,t-,z{l,t,...,t n x ) 
z \X\ t 2nW 


Cl \, . . . , &r +1 

b u ...,b r 

(t n , Qi, . . . , Clr+1] q, t)\ _ 

(b!,...,b r ;q,t)x C x (q, t] q, t) 


Since C~(q,t] q,t) = ( q,t;q) r we have r+1 $ d ' ) = r+] d r with on the right an 
ordinary basic hypergeometric series, see [27]. Due to the factor (f n ; q,t)\ the 
summand vanishes unless /(A) ^ n. For generic bi,... ,b r the restriction in the 
sum over A may thus be dropped. If a r+ i = q~ m the series terminates with 
support given by A C m n . If 

£ n_1 ai • • • a r+ 1 = b\- ■ -b r and z = q 
we say that a r+ 1 < h|. n ' ) is balanced. 
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Replacing A by its complement with respect to m n and using (12.611 gives 


(5.47) 


r+l r 


CL\i . . . , CL r , Q 




bi,... ,b r 

z\ mn -nM t m(j) ( a U ••■Ai q, *)m" 
q' {bi,...,b r -,q,t) m n 

ql-m-f.n-1 ; 


x <f> (n) 

x r+l^r 


gi-^-i/ai,..., q 1 ~ in t n ~ 1 /a r 


;q,t] 


bi ■ ■ ■ b r q m+1 
ai • • • a r 2(t n_1 


Similarly, replacing A by its conjugate and applying (12.4j) yields the duality 


(5.48) , +1 4.<”> 


1/di,..., l/a r , t n ai---a r zt n 
1/h, • • •, l/&r &i • ■ ■b r q m 

The expression of the (monic) Askey-Wilson polynomials as a balanced 4 0 3 
series [3] has a perfect analogue for the Koornwinder polynomials indexed by 




(m) 


di, , 


a r , q “ 
bi,...,b r 


-,q,t;z 


Lemma 5.15. Form a nonnegative integer 
(5.49) K m u (z( 1, t,..., t n_1 ); q, t; t Q , t 1: t 2 , t 3 ) 

l (£) (t 0 t 1 t n ~ 1 , tpM 71-1 , q, t) r 


_ _L—mn_L—m[ 

— l 0 l 


X <J> (?l) 
X 4^3 


(t 0 t 1 t 2 t 3 q m ~ 1 t n - 1 -, q,t ) 

Va tptit 2 tpq m ~ l t n ~ l , q~ m 
t 0 t 1 t n - 1 ,t 0 t 2 t n - 1 ,t 0 t 3 t n - 1 

For later use we note that by (15.471) and 

(5.50) (a-q,t ) m » = (-a) mn g n ( 2 )^( 2 ) ( g 1 - m i’ l - 1 / a; q, t) m n 
we may rewrite (I5.49jl as 

(5.51) K m n (z( 1, t,..., t n_1 ); g, f; t 0 , fi, t 2 , < 3 ) 

= --^—( 2 ) (^r- 1 , zq x - m t n ~\ /t 0 ] q, t) m n 

' q^/toh, q l - m /tpt 2 , q^/toh, q~ m 
_zq 1 - m t n ~ 1 /t 0 , q 1 ~ m /zt 0 , q 2 ~ 2m /t 0 tit 2 t 3 


\q,t\q 


(n) 


X 4 $3 


\q,t\q 


Proof of Lemma 1 5.1 51 Okounkov’s binomial formula [73] Theorem 7.10] gives 
an expansion of the Koornwinder polynomials in terms of BC n interpolation 
polynomials P*(x; q, t, s ) [731(77]. The coefficients in this expansion are given 
by BC„ g-binomial coefficients [*] ^ (see e.g., H3 page 64]) times a ratio of 




























76 


ERIC M. RAINS AND S. OLE WARNAAR 


principally specialised Koornwinder polynomials: 


£ 

fiC\ Ll 


K\(t 0 (l,t,...,t n 1 y,q,t-,tQ,ti,t 2 ,t3) - 

q,t,s ■ ■ ■ ,t n - 1 )-,q,t-,t 0 ,t 1 ,t 2 ,t 3 ) M X,g ’ ’ 0 ’ 


where s = t n 1 \/t 0 tit 2 t 3 / q . 
Now let [77] 


<?+(*; 9, *)== II (1- V i+ ^ 2_A ^)- 

(*j) ga 


By [771 Proposition 4.1] 


m 
. I 1 


= , a) M t nM nW (t n ,q m ,s 2 q m t 1 

C~(q,t-,q,t)C+(s 2 -,q,t) 


and the specialisation formulas [231185] 

Jl A (t 0 (l, t ,..., t n_1 ); g, t; t 0 , < 1 ,^ 2 , h) 

= t n ^ ' (t n , t 0 t 1 t n - 1 ,tot 2 t n - 1 ,tot 3 t n - 1 \ q, t) x 
(t 0 t n_1 )l A l C*(t; g, t)C^ {t G t l t 2 t 3 t 2n - 2 /q- q, t ) 


and [77[ Corollary 3.11] 

P;(^(l,t, ...,t n_1 );g,t,s) = 
we obtain (I5.5ip . 


t 2n (Cg n (P) ( t n ,s/z,szt n 1 ;q, t) A 


(-st n C (t\q,t) 


□ 


Lemma 12.31 implies an analogue of (]5.51j) for the Macdonald-Koornwinder 
polynomial K m n(q, t; t 2 , f 3 ). 

Lemma 5.16. Form an integer or half-integer 

(5.52) K m n(z(l,t ,... ,f n_1 );g,t;f 2 ,t 3 ) 

= (-zq 1 / t ) (2m)n 


X 


(n) 


4^3 


~l/2—m / + „l/2—m /+ ri \l2—m „—m 

—q / t 2, —q /Hi q , q 

—zq 1 / 2 ~ m t n ~ 1 , —q 1 / 2 ~ m /z, q 3 / 2 ~ 2m /t 2 t 3 




Proof. In the integer case (]5.52[) follows immediately from (15 .51 [) by specialising 
{t 0 ,ti} = {~q 1/2 , -1} and applying 


(5.53) 


b aq m ]q,t) m n = (aq m ;g,f) (2m )-. 
























BOUNDED LITTLEWOOD IDENTITIES 


77 


By Lemma [2.31 for m = k + 1/2 a half-integer we need to show that 
(5.54) K k n (z( 1, t,..., t n_1 ); g, t; -g, -g 1/2 , t 2 , t 3 ) 

= z~ kn r k( y a) (-zg-ty*" 1 , -zgt"" 1 ; g, t) fc » 


x 


(n) 


4^3 


-g fc Aa, Vo? g k l/2 ,q k 

—zq~ k t n ~ l , — q~ k / z , q 1 ! 2 ~ 2k /t 2 t 3 


\q,t\q 


where we have also used 


n(4 /2 + ^ 1/2 )L,^-, = --” /2 ‘-©^(-,;t). 




and 


(-■sg 1 ',q,t)(2k+ir 

( Z, t'jn 


= {-zq k t n 1 , zqt n ]q,t) k u. 


Since (j5.54(1 is (I5.5ip with (t 0 ,ti,m) (->• (—g, —g 1 / 2 , k ) we are done. 


□ 


Equipped with the above lemmas we can specialise Theorems 14.11 and 14.61 
to obtain new transformation formulas for Kaneko-Macdonald-type hyperge¬ 
ometric series. 


Proposition 5.17. Form a nonnegative integer 

a, —a, —t n , q~ m 
aq 1 / 2 t n , — aq 1 / 2 ^, —q~ m /t 

(a 2 t) mn q m2n (qt 2n ] q, t) 


$0) 

4^3 


:,q,t-,q 


( a 2 qt 2n ; q 2 , t 2 ) m n (-gt n ; g, t) r 


<j>( n ) 

2^1 


q- m /t,q~ m . 2 q_ 
qt 2n ~ i ’ ’a 2 


Interestingly, even the n — 1 case of this transformation, given by 
a, —a, b , g~ m 


403 


abq 1 / 2 , —abq 1 / 2 , q~ m /b ’ 


g,g 


(—a 2 b) m q m2 (b 2 q-, q) r 
(a 2 b 2 q; q 2 ) m {bq ; g)„. 


2<yi 


-q m /b,q~ 
—bq 


q 

;g, — 
a 1 


appears to be new. 

Proof. In (14.5|) we specialise £ z(l,£,... ,t n_1 ) and replace the summation 

index A by 2A. On the left side we then use 

'q\\M (g~ 2m ; q 2 , t)\ Cf(qt;q 2 ,t) 


«-(«•*)=(?) ^ 


(g 1 2m /t-,q 2 ,t) x C x (g 2 ; g 2 , t) 
(see the proof of Theorem 14.11 on page 145]) and 


Pc 


2A 


™ ~2|A| t 2n(A) = c2 |A| f 2n(A) (t", g*"; g 2 , t) A . 

C' 2 \{t,q,t) C x (t, qt; q 2 , t) 
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This yields the 2 < h/'' ) series 




(n) 


qt n ,q 2m 2 z 2 q 
L q x - 2m /t ' ,q ,t] ~ 


On the right we use (15.51(1 with 

t 2 ,t 3 ) = ( q 1/2 ,-q 1/2 ,(qt) 1/2 ,-(qt) 1/[2 ) 

and (j5.53(1 to find 


(zq l/2 m t n 1 ;g,t) ( 2 m)» 4 $: 


(n) 


-77i j.—1/2 _ n —rri-f-—1/2 

i , H 1 > 


zq l l 2 ~ m t n ~ l , q 1 / 2 ~ m /z, q~ 2m t 


n ~m r/ —m 

H ) i 

; 9,*;9 


We now apply the duality ((5.48(1 to both sides and interchange m and n as 
well as q and t. By 

(a, q)n m ^ iQjt}m, n 

(which follows from f!2.4a| and (I2.6al) for A = m n ) this yields 


$0) 

2 V 1 


9 m /t,q 


'1\ -,q,t 2 -z 2 q 2m t 


qt 2? 


= (*t n 1/2 ; q,t) m 2 n 4 $3 


(n) 


g 1//2 t n , —q l / 2 t n , —t n , q m 
zt n ~ 1 / 2 ,q 1 ~ m t n ~ 1 / 2 /z, qt 21 


19, *5 9 


Next we rewrite the right-hand side using the multiple Sears transformation [4J 
Eq. (5.10)] 


(5.55) 4 <f> 


(n) 


a, b, c, q 


5 9,^9 


with 


and use 


3 L^e^-’-P^a&c/de’ 

_ (e/a, de/bc] q, t) m ^ -(n) T a, d/6, d/c, q~ m 

(e,de/abc;q,t) m n 4 3 d, de/bc, q 1 ~ rn t n ~ 1 a/e ’ ^ 

(a, 5, c, d, e) ha (-t n , q^ 2 t n , -q 1/2 t n , zt n ~ 1/2 , q x - m t n ~ xl2 jz) , 


(■ Zt U 1/2 ; q, t) m 2n 


(~zt 1/2 , —q m /t- 1 q,t) n 
(. zt n ~ 1 / 2 , q~ m t~ 1 ~ n ] q, t) r 


(z 2 t 1 ]q 2 ,t 2 ) m n(-q m t 1 ',q,t) r 


(9 m t 1 n -,q,t) m n 

to clean up the prefactor. By the substitution z ha g 1 / 2-m t -1 / 2 /a and applica¬ 
tion of (15.501) the claim follows. □ 
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Proposition 5.18. Form a nonnegative integer 


(5.56) 


(n) 


a,aq,q m , q 1 m 2 2 . 2 ‘ 
aq 1 ~ m /t, aq 2 ~ m /t, qt 2n ' q ,q 

(t 2 n ;q 2 ,n 


(f 2n , f 2ri_1 /a; g, f 2 ) f 


2^ 


-t n ,q~ m q 

_qi- m /f q ^ ~ 


For 7i — l, and up to the change t b, this is a transformation stated on 
page 2310 of [6]. By iterating the Sears transformation (I5.55P we obtain 




(n) 


a,b,c,q~ 


-,q,t-,q 


4 3 [ d,e,q 1 ~ m t n ~ 1 abc/de 1 

(a,ef/ab,ef/ac;q,t) r 


$ 


(n) 


4 3 


e/a, f /a,ef /abc,q m 
ef /ab, ef /ac, q 1 ~ m t n ~ 1 /a 


\Q,t\q 


(■ e,f,ef/abc ; q,t)„ 

where / := q 1 ~ m t n ^ 1 abc/de. If we let b tend to zero and c, d —» oo such that 
c/d ^ z/q, we find 


2 <&i n) 


a,Q~ 


-,q,t-z 


(< a,zq l m t n l ',q,t ) 


(e;g,t) r 


m T ‘ ^(n) 
3^2 


0 ,e/a,q m 
_ Z q- m t n ~ 1 ,q x - m t n ~ x / a 


',q,t;q 


This can be used to transform the right-hand side of (I5.56[) so that an equiv¬ 
alent form of that identity is given by 


$0) 

4^3 


a, aq, q m ,q 1 m 2 2 2 
aq 1 ~ m /t,aq 2 ~ m /t,qt 2n,q , ’ ^ 


= q 


i(™) {a;q,t) m n(t 2n -,q 2 ,t 2 ) m n (n) 

V > — ---:----- 3 V 2 


(■ aq 1 ~ m /t,t 2n -q,t 2 ) r 


0 ,q 1 - m /t n+1 ,q~ m 
-q x ~ m /t,q x ~ m t n - x / a 


; \q,t\q 


This generalises the c = aq 1 m /t case of Jain’s quadratic transformation [361 
Equation (3.6)]: 


4S"3 


a,aq,q m , q 1 m 2 2 

’,q ,q 


c, cq, qt 2 


(n, q) m (t , q) m 
= q (c** 


0, c/a, q 1 ~ m /t 2 , q~ m 
_q 1 ~ m /t, —q 1 ~ m /t, q l ~ m /a 


-,q,q 


Proof of Proposition \5 .1 H This time we specialise x = z{l,t 2 , . . . ,t 2n 2 ) in 
(I4.12j) . On the left we use (12.301) and 

h~ ( n t\ - ( g V A| C//(-t-q,t) 

A;mW ’ J V t) (-q'-™/t,q,t ) A C;(q-,q,t)’ 
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(see the proof of Theorem 14.61 on page [48]), as well as 

(a 2 ; q 2 , t 2 )\ = (a, —a; q, t)\ and C\(a 2 ; q 2 ,t 2 ) = C\(a, -a; q,t). 
On the right we first write 

P^f n \x; q 2 1 t 2 , -t) = K { rn )n ( x -, q 2 , t 2 ; -t, - qt) 


using (I2.50bj) . then specialise x and hnally apply (15. -52[) . As a result, 


A”’ 


-t n , q m zq 

-q 1 - m /t ,q ' ’ T 


= (-zq 1 -™ t 2n ~ 2 ;q 2 ,t 2 ) 


X4$3 


(n) 


n —m I-f- n l—m / j . n —m n l—m 

q / q / L ^q -,q 

—zq l ~ m t 2n ~ 2 , —q 1 -™'/z , q 2 ~ m /t'- 


2 j.2 2 

,t \ q 


Again we apply the Sears transformation (I5.55|) . this time with 
(a, b , c, d, e, m, q, t ) 

( gl -2fm/2l 5 q -m/ t ^ Q 1 -m/^ _ g l-m/^ _ zq l-m t 2n-2^ ^ m / 2 J ? q 2 > tfy 


Noting that 


(_ -v.0-m.2n-2. 2 


/ /y/ ~—m+2rm/2l j.2n—2 ~-z.2n.~2 j.2\ 

{-zq ^ 1 / 't ,qt ,q 

f r/7 l—mv-2n—2 /7 2fm/2l-/-2n. >^2 f2V . . 

(t 2n , -zt 2 n ~ 2 -,q,t 2 ) m n 
(t 2 n ;q 2 ,t 2 ) m n 


and replacing 2 ; i-> —t/a completes the proof. 


□ 


6. Open problems 

We conclude this paper with a list of open problems. 

If we specialise {t 2 ,t 3 } = {it 1 / 2 } or {t 2 ,t 3 } = {iit 1 / 4 } in Theorem 14.71 then 
the Rogers-Szego polynomials in the summand factorise by (12. lip . 

Open problem 1. Find q-analogues of 

( 2m— 1 \ 

n (*; * 2 )K(X)/ 21 )t) = (n • • t,i) 

i=l ' 
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and 

( 2m —1 

JI ( t l/2 ] t ) f mi ( A)/2] (-<; *) [mi(A)/2j 

1=1 
i even 

( 2m—1 \ 

n (t; t 2 )Tn*(A)/2 ) -F*A(a:; = (xi ■ ■ ■x n ) m P!Sr ) (x-,t,t 1/2 ). 

1=1 ' 

i odd 

In both cases the sum is over partitions X such that Ai ^ 2 m andmi(X) is even 
for i = 1,3,..., 2 m — 1. 

Similarly, if we specialise p — 0 in Theorem 14.81 then the Rogers-Szego 
polynomial in the summand trivialises to 1. 

Open problem 2. Find a q-analogue of 

E (M) = (xi • • 0). 

A 

Ai^m 


The bounded Littlewood identities proven in this paper correspond to de¬ 
compositions of (P, S') Macdonald polynomials (or R Hall-Littlewood polyno¬ 
mials) indexed by rectangular partitions or half-partitions of maximal length. 
In the Schur case more general shapes have been considered in the literature. 
For example, Goulden and Krattenthaler p0j[4D[45j proved that the following 
formula for the character of the irreducible Sp(2n, C)-module of highest weight 
A r + (m — l)A n : 

'y 1 S\(x) = (xi ■ ■ ■ X n ) sp2n,(m n - r (m-l) r )( x )i 

A 

Ai ^2m 
odd(A)=r 

where 0 ^ r n (and Ao := 0). For r = 0 this is the Desarmenien-Proctor- 
Stembridge formula (14.61) . 


Open problem 3. (i) For positive integers m,n and r an integer such that 
0 ^.r^n, prove that 

E fe Atm,r(?> t)P\(x; q, t) = (x 1 ■ ■ • x n ) m p£ 7 LV B ( Ei)r (x; q, t, qt ), 


A 

odd(A)=r 


where 




s<E A/l r 
a^(s) even 


X _ q2m-a' x {s)-l-fl' x (s)+l 


[ii) Prove similar such u non-rectangular” identities for other (R,S). 
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The map e Q1 ,..., e Q " ha 1 is known as the basic specialisation EH 
Applied to character formulas for affine Lie algebras leads to (generalised) 
Dyson-Macdonald type expansions for powers of the Dedekind eta-function, 
see e.g., [5l l2Hl6Tll69l 1901198] . For example, taking the basic specialisation of 
identity (15.181) (and replacing t by q) yields the following generalisation 
of j62j p. 135, (6c)]: 


( 6 . 1 ) 


?7(r/2) 2n 77(r) 2n2 3n 


E , . M-IpI , , . HOI -IIPII | IIPII 

( — 1) rn+2n-l jpj q 2(m+2n-l) ~ 2(2n-l) 

m— 1 

= E 9 w/2 -p;(E.m9) II(-9 I/2 ;9 I/2 ) m .(A). 


A 

Ai^ra 


2n— 1 times 


2=0 


Here q = exp(27rir), p = (n — 1,..., 1, 0), 

Xd (v/w) := fj(u, 2 - v 2 )/{w 2 - w 2 ), 


i<j 


and the sum is over neZ” such that Vi = p t (mod m + 2n — 1). 

Let C = C n be the Cartan matrix of A n , i.e., (C -1 )^ = min{a, b} — ab/(n + 
1), and for i^k a set of nonnegative integers, let 


R p w + ... +r (“>. 


Following [51138] we define 
f(-9 1/2 ;9)S _1 


Fk,n{q) ' < 


(-9 1/2 ;9 1/2 )L”-‘ E 


0 “’) 


1 yvn p( a ) d( & ) 

q 2 2^ a ,b=l 2^i =1 

nLi nS=i ((?; o) r w) te 2 ; ? 2 )>> 


for k = 0 
for k > 1 


and 


G fc , n (g) := {-q\q)l 0 J] 


E:,i=i Eti C ai R(“ ) Rf ) (_ g l/2-R« . 


A 


,(i) 


0“’) 


n:i.i nti'((9;9) r (..)(9 2 ;9 2 ) r (.) 

\‘i s 1 

for k ^ 1. 

Open problem 4. For m, n positive integers, prove that 


m— 1 


E 9 W/ 2 A(A;.. 1 ; 9 )II(- 9 1 / 2 ; 9 1/2 ) 


m; (A) 


A 

Ai^m 


2n—1 times 


2=1 


X J Fk,2n-i(q ) if m — 2k + 1 
Gk, 2 n-i(q) if m — 2k. 
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For n — 1 this follows from a minor modification of [96] Lemma A.l], for 
m— 1 it follows from P' ]r ) ( x ',t) = e r (x) and 


OO 


y ~Ve r 

r =0 


" n " 
.1 - q. 


i~z;q) 


n 

oo i 


and for m — 2 a proof is given in [5, Theorem 3.7]. By (16.Tj) the above problem 
for even m is equivalent to [98] Conjecture 2.4; (2.6a)]. 


Most of the virtual Koornwinder integrals of Section [3] have elliptic ana¬ 
logues, see USED]. 


Open problem 5. Prove elliptic analogues of the bounded Littlewood identities 
of Theorems \4.1\\f.6\ 

For elliptic analogues of (14. ID - 04. 3p we refer to [79]. 


Appendix A. The Weyl-Kac formula 


In this appendix we state some simple consequences of the Weyl-Kac for¬ 
mula, needed in the proofs of our combinatorial character formulas in Sec¬ 
tion 15.11 

Recall the symplectic and odd-orthogonal Schur functions (12.601) and (j2.62]) . 
It will be convenient to also define the normalised functions 


(A.l) SO2n+l,A0) = A B (x) SO2n+l,A0) and Sp 2n>A (x) = A C (x)s02n+lAx), 

so that S02n+I,o(z) = AbOe) and sp 2ni0 (a:) = A c (x). 

Mimicking the proofs of [5] Lemmas 2.1-2.4] yields an expression for the 
characters of and A 2 ^_ 1 in terms of the symplectic and odd orthogonal 
Schur functions as follows. 

Lemma A.l (B^ character formula). Let 

(A.2) Xi := e ~ ai —- an (1 < i ^ n), t := e ~ s , 

and parametrise A G P+, as 

A = coA 0 + (Ai — A2)Ai + • • • + (A n _i — A ri )A n _ 1 + 2A„A n , 

where cq is a nonnegative integer and A = (Ai,...,A n ) a partition or half¬ 
partition. Then 


(A.3) e -A ch V (A) 


1 

fa t)so mu 6 ( x l t) x i e ( x i/ x v x i x T t) 

n 

^2 S02n +1 ,A (Xf) [J ^+Ai f ^r?-(n-i)r s 

rGZ n i =1 

M=o (2) 


X 
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where k = 2n — 1 + Co + Ai + A 2 . 

Lemma A. 2 (A 2 „_ 1 character formula). Let 

(A.4) Xi := e~ ai on-i-an/2 (1 ^ n), t := e~ s , 

and parametrise A e P+, as 

A = C 0 A 0 + (Ai — A2 )Ai + • • • + (A„_i — A n )A r j_i + A n A n , 
where c 0 is a nonnegative integer and A = (Ai,..., A n ) a partition. Then 


(A.5) 

e _A ch V (A) 


1 

(t- t^it 2 ; 1 2 )^ n;=i ^( a 2 ; t 2 ) rii^<Kn *) 

n 

rEZ n 2—1 

|■r|=0 (2) 


where k = 2n + c 0 + Ai + A 2 . 

Taking (co; A) = (0; (m/2) n ) in Lemma [A. II and (0,m n ) in Lemma [A.21 the 
above two formulas may be rewritten as a D n -type sum over the full TT lattice. 

Lemma A.3 (Bn ^ and A^ 2 ^ character formulas). Let 

(A.6) Xi := e -Qi “n-i+ten-i-“~)/ 2 (1 ^ ^ n), t := e~ s . 


Then 


r mAo ch V(mA 0 ) = 


x 


(t; «)So nil, #(* 1/2 ^; f) *) 

n 

J2 a D ( zt r ) JJ(-l) ri a;f ri i3 ,er ?- (n - 1 > i , k = m + 2ra - 1, g = B^ 


rGZ 71 


i= 1 


and 


(A.7) e _mAo ch V(mA 0 ) 


x 


(f; fc 1 ^ 2 ; i2 )oo ECU 9 ( tx h f2 ) I\i^<^n x i 6 (. x i/ x L x ^ x t t) 

n 

J2 Ad( xt r ) JJ(-l) ri a;r^' sr * ? “ (n “ 1)ri , « = 2m + 2n, g = Agl,. 

rgZ 7 * i=l 
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For m = 
identities: 


0 this gives what may be regarded as B 


(i)t 


and A 2 ^ 1 , 


Macdonald 


^ A B (xf) JJ(-l) ri 4 2n_1)ri t (2n - 1) (2)+^/ 2 

rEZ n i =1 

n 

= (^;^)wH^(^ 1/2 ®*;^)°o IJ x j e(x i /x j ,x i x j ]t) 

i=l 1 ^i<j^n 


and 


^ A D (xt r ) JJ(-l) ri x? nri t 2n (a)+ r ‘ 
rez n i=1 

n 

= ~[d(txl]t 2 ) JJ x j 9(x i /x j ,x i x j -,t). 

i= 1 l^i<j^n 


Proof. We first consider the B„ case. 

Setting (c 0 ; A) = (0; (m/2) n ) in (IA.3j) and using (12.62(1 and (IA. 1(1 yields the 
Bn character formula 


(A.8) 


mA " ch V(mA n ) 



|r|=0 (2) 


1 

(f; *)« nr=i t) Ul^iKj^n XjOfXiXj, Xi/Xj ; t) 

a .Kr i +j-l^K( r 2 i)+(j-l)r i _ a .Khi + l)-j+l^K( r i+ 1 )-(j-l)rF 


> 


with k = m + 2n — 1 and Xi,... ,x n given by IA.2I Replacing (->• a n _j for 
0 ^ i ^ n changes A„ to A 0 on the left. On the right it has the effect of 
replacing (1A.2|) by 


Moreover, t is now given by t — e _2a ° 2 a„_ 2 -a„_i-a ri - n acGO rdance with the 

interpretation of S as the null root of B^ instead of B^. 

Next we replace Xi t->- f 1 / 2 /x n+ \-i —so that X{ is now given by (1A.6D — and 
r% r n+ j_i for 1 ^ i ^ n. Also reversing the order of the rows and columns 
in the determinant and using 9(x]t) = 9(q/x]t), we obtain 


-mAo ch y ( mAo ) = 


/o 






x j (x i x j , Xi/Xj] £)’ 
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where for a = 0,1 

f a := Y t det^ 

re I n 

\r\=a (2) 

— a; 7 ,c ( r i+ 1 )+ 2n —J- 1 ^|«(ri+l) 2 -(ra-j)(r i +l)\ 

The claim now follows from the identity 

n 

So = (-i)’ Y aw 


(A.9) 


\~[(-l) ri xpq^ r i- ,n - l>r ‘. 


i =1 


To finally prove (lA.9j) we proceed as follows: 

fo±fi=Y det 

r€jj n 

_ ('_]^^(l : Fl)n^K(r i +l) 2 -(n-j)(r i +l) a ,-Khi+l)+2n-j-l^ 

= det (Y(-l)*^ )r t*'^ +{n - 3 ' )r xT Kr+j - 1 

x r€Z 

_ ^~^ ('_^^( 1 T 1 h^«h+ 1 ) 2 -(^-j)h+ 1 ) a; 7 K ( T '+ 1 )+ 2n ~J~ 1 ^ 

rGZ ' 

- det ( Y(-l)^ 1 )r t |«r 2 -(n-j)r «r+i-l 

<Ci n<Cn. V • ^ 

rSZ 

=F ^(-l)^^ 

rGZ 

V det f (-l)^ 1 )^!^?—(«— 

^ 17*77n \ 
rGZ n ' 




i«:r 2 +(n— j)r Kr+2n—j —1 

Jy A 


Here the second and last equality use multilinearity and the third equality 
follows from a shift of r ha r — 1 in the second sum over r. When j = n the 
final line reads (1 =F 1 )(xjf ri ) n , so that /o + /i = 0. Moreover, by the D n 
Vandermonde determinant (12.65I) . 


1 


a - h = ? y alo ni-D^ 




rGZ 71 


2—1 


This completes the first part of our proof. 
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The a£ ] _! case proceeds in almost identical fashion. This time we set take 
(c 0 ; A) = (0;m n ) in flA.Sjl . Using (I2.60j) and (1A.1I) yields the A^_ x character 
formula 

e~ mAn ch V(mA n ) 

1 

(t; t 2 ) oo n"=i 9 ( x h 12 ) *) 

-(j-l)ri'j 

kl-° ( 2 ) 

with k = 2m + 2n and xi,...,x n given by IA.41 Noting that the summand is 
exactly the same as in (1A.8I) the rest of the proof follows mutatis mutandis. □ 


x 


V det _ "(n+iW+yf 


h +1 ) 
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